-- Logs begin at Mon 2022-08-29 20:49:40 UTC, end at Mon 2022-08-29 21:54:41 UTC. -- Aug 29 21:24:53.317650 dv-cinder-854267-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:24:53.327295 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:24:53 2022] *** Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: nodename: dv-cinder-854267-3-iscsi Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: machine: x86_64 Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: clock source: unix Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: pcre jit disabled Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: detected number of CPU cores: 4 Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: current working directory: / Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: your processes number limit is 47680 Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: your memory page size is 4096 bytes Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: detected max file descriptor number: 2048 Aug 29 21:24:53.329315 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: lock engine: pthread robust mutexes Aug 29 21:24:53.330475 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: thunder lock: enabled Aug 29 21:24:53.330475 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:24:53.330475 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:24:53.370430 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: Python main interpreter initialized at 0x561a09d729c0 Aug 29 21:24:53.370430 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: python threads support enabled Aug 29 21:24:53.370430 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: your server socket listen backlog is limited to 100 connections Aug 29 21:24:53.370430 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:24:53.370892 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:24:53.370892 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: *** Operational MODE: preforking *** Aug 29 21:24:53.371096 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:24:53.371096 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: spawned uWSGI master process (pid: 105412) Aug 29 21:24:53.371293 dv-cinder-854267-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:24:53.372395 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: spawned uWSGI worker 1 (pid: 105413, cores: 1) Aug 29 21:24:53.372395 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: spawned uWSGI worker 2 (pid: 105414, cores: 1) Aug 29 21:24:53.372395 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:24:54.037139 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:24:54.050078 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:24:55.132632 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:55.132632 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: from cryptography.utils import int_from_bytes Aug 29 21:24:55.133234 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:55.133234 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: from cryptography.utils import int_from_bytes Aug 29 21:24:55.133632 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:55.133632 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: from cryptography.utils import int_from_bytes Aug 29 21:24:55.133941 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:24:55.133941 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: from cryptography.utils import int_from_bytes Aug 29 21:24:57.621368 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:24:57.622066 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:24:57.622157 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:24:57.622157 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:24:57.622561 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:24:57.622561 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:24:57.622687 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:24:57.622770 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:24:57.622963 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:24:57.623102 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.623202 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:24:57.623421 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.623569 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.623738 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.623899 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.624052 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.624224 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.624375 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.624552 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.624706 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.624881 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.624982 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.625194 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.625291 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.625516 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.625614 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.625852 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.625977 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.626166 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.626262 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.626431 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.626519 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-3-iscsi {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.626749 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.626836 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.627076 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-3-iscsi {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.627164 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.627378 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.627464 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.627695 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.627793 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.627997 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.628083 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.628314 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.628409 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.628615 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.628700 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.628936 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.629111 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.629244 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.629551 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.629758 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.629883 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.630099 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.630195 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.630422 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.630531 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.630722 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.630832 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.631063 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.631160 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.631379 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.631475 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.631684 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.631777 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.632003 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.632100 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.632311 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.632414 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.632634 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.632720 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-3-iscsi {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.633555 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.633656 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.633925 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.634240 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.634328 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-3-iscsi {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.634561 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.634655 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.634885 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.634984 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.635205 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.635303 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.635534 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.635633 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.635853 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.635940 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.636157 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.636243 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.636491 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.636590 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.636806 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.636901 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.637122 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.637208 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.637439 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.637526 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.637737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.637849 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.638066 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.638169 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.638378 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.638465 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.638693 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.638786 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.638996 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.639090 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.639297 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.639390 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.639543 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.639629 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.639845 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.639943 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.640161 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.640258 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.640441 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.640526 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.640758 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.640857 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.641155 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.641366 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.641460 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.641542 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.641714 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.641832 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.641997 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.642089 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.642252 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.642351 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.642576 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.642664 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.642900 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.642999 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.643214 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.643311 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.643524 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.643625 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.643828 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.643916 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.644132 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.644229 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.644436 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.644530 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.644741 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.644836 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.645050 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.645146 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.645356 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.645446 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.645656 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.645743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.645999 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.646101 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.646324 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.646418 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.646622 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.646710 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.646926 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.647015 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.647260 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.647350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.647574 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.647672 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.647876 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.647964 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.648196 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.648284 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.648580 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.649200 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.649465 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.649557 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.649772 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.649904 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.650097 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.650237 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.650415 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.650567 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.650747 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.650870 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.651048 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.651182 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.651296 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.651508 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.651602 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.651845 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.651933 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.652156 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.652246 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.652410 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.652503 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.652715 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.652882 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.653025 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.653113 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.653326 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.653413 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.653628 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.653724 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.653953 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.654044 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.654254 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.654342 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.654553 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.654659 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.654856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.654951 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.655156 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.655248 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.655457 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.655553 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.655756 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.655856 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.656061 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.656176 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.656364 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.656476 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.656669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.656757 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.656969 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.657053 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.657272 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.657425 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.657595 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.657748 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.657941 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.658082 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.658218 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.658321 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.658528 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.658615 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.658836 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.658931 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.659145 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.659239 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.659445 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.659537 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.659748 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.659845 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.660055 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.660155 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.660354 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.660441 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.660681 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.660777 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.660969 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.661057 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.661267 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.661353 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.661568 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.661654 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.661904 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.661997 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.662213 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.662299 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.662513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.662599 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.662813 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.662901 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.663111 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.663204 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.663411 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.663497 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.663714 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.663801 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.664012 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.664150 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.664470 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.664574 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.664775 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.664871 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.665085 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.665236 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.665393 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.665503 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.665703 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666064 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666064 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666283 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666428 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666521 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666626 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666722 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.666949 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.667050 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.667259 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.667355 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.667568 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.667661 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.667891 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:24:57.667979 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.668226 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.668313 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.668557 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.668643 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.668874 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.668959 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.669184 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.669271 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.669494 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.669579 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.669835 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.669925 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.670149 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.670237 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.670459 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.670545 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.670772 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.670910 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.671089 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.671238 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.671391 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.671530 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.671710 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.671854 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.672019 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.672184 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.672331 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.672480 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.672624 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.672768 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.672925 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.673072 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.673238 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.673377 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.673562 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.673775 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.673972 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.674110 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.674246 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.674388 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.674534 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.674678 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.674815 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.674972 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.675140 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.675229 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.675455 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.675557 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.675770 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.675863 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.676078 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.676174 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.676405 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.676651 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.676753 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.676846 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.677002 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.677091 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.677330 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.677421 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.677639 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.677727 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.677978 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.678080 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.678292 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.678387 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.678613 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.678701 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.678924 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.679014 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.679231 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.679321 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.679538 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.679634 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.680458 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.680548 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.680769 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.680969 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.681106 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.681260 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.681421 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.681578 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.681742 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.681919 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.682082 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.682238 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.682391 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.682583 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.682707 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.682906 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.683016 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.683231 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.683321 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.683554 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.683645 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.683871 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.683960 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.684195 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.684283 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.684496 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.684591 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.684803 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.684903 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.685104 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.685201 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.685412 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.685500 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.685727 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.685843 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.686056 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.686387 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.686474 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.686558 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.686677 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.686841 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.687000 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.687152 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.687300 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.687439 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.687582 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.687719 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.687890 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.688046 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.688237 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.688315 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.688561 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.688699 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.688904 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.689048 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.689232 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.689447 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.689718 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.689841 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.689942 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.690097 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.690196 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.690415 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.690505 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.690729 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.690832 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.691037 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.691136 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.691343 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.691432 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.691649 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.691784 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.691958 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.692047 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.692266 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.692354 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.692574 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.692663 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.692879 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.692966 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.693187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.693276 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.693499 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.693587 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.693837 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.693999 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.694145 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.694283 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.694453 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.694590 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.694768 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.694906 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.695078 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.695214 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.696067 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.696175 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.696363 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.696536 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.696668 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.696856 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.697007 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.697188 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.697335 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.697520 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.697657 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.697863 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.698013 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.698160 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.698292 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.698459 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.698595 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.698761 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.698906 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.699061 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.699198 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.699367 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.699512 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.699674 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.699809 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.699965 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.700100 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.700259 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.700405 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.700548 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.700689 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.700862 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.700998 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.701155 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.701250 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.701481 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.701570 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.701809 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.701900 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.702125 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.702229 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.702432 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.702527 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.702739 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.702827 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.703053 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.703147 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.703364 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.703450 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.703674 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.703768 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.703983 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.704072 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.704291 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.704386 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.704608 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.704696 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.704915 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.705002 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.705234 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.705326 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.705542 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.705629 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.705886 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.705977 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.706198 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.706295 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.706507 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.706593 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.706811 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.707038 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.707195 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.707334 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.707472 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.707608 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.707754 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.707892 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.708039 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.708182 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.708344 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.708492 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.708666 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.708806 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.708975 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.709124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.709267 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.709418 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.709563 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.709703 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.709890 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.710025 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.710169 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.710314 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.710488 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.710627 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.710796 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.710948 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.711214 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.711419 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.711696 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.711835 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.711970 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.712118 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.712263 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.712407 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.712546 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.712681 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.712818 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.712979 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.713128 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.713294 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.713433 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.713619 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.713765 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.713943 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.714097 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.714244 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.714381 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.714557 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.714703 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.715129 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.715281 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.715439 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.715585 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.715745 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.715882 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.716051 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.716214 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.716359 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.716468 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.716663 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.716751 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.716974 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.717063 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.717283 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.717373 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.717588 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.717676 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.717913 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.718006 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.718235 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.718334 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.718541 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.718627 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.718840 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.718930 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.719151 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.719243 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.719470 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.719557 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.719785 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.719880 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.720097 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.720184 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.720408 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.720509 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.720724 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.720810 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.721028 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.721126 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.721332 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.721427 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.721640 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.721726 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.721978 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.722068 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.722280 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.722387 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.722582 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.722682 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.722883 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.722978 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.723221 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.723319 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.723527 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.723613 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.723828 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.723914 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.724139 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.724227 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.724451 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.724536 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.724755 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.724840 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.725059 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.725152 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.725364 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.725451 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.725671 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.725758 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.726037 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.726133 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.726351 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.726474 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.726734 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.726882 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.727062 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.727220 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.727376 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.727467 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.727695 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.727793 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.728007 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.728093 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.728319 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.728412 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.728625 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.728723 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.728935 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.729030 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.729245 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.729340 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.729549 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.729644 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.729882 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.729999 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.730198 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.730284 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.730517 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.730771 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.730859 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.731099 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.731187 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.731412 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.731511 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.731726 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.731812 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.732034 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.732121 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.732349 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.732446 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.732672 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.732773 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.732996 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.733243 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.733331 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.733580 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.733682 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.733913 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.734001 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.734217 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.734306 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.734518 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.734615 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.734826 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.734912 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.735125 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.735221 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.735425 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.735512 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.735727 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.735815 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.736033 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.736120 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.736333 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.736434 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.736636 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.736734 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.736933 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.737021 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.737234 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.737330 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.737542 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.737630 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.737864 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.737965 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.738179 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.738275 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.738479 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.738571 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.738783 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.738876 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.739089 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.739182 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.739388 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.739481 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.739687 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.739773 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.739985 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.740081 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.740292 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.740379 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.740610 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.740705 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.740919 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.741015 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.741246 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.741333 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.741559 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.741651 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.741888 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.741979 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.742748 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.742900 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.743074 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.743155 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.743425 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.743554 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.743739 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.743847 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.744082 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.744170 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.744414 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.744503 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.744734 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.744827 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.745035 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.745128 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.745343 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.745431 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.745649 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.745736 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.745980 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.746078 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.746287 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.746381 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.746583 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.746780 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.746889 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.746990 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.747189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.747331 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.747491 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.747584 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.747795 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.747890 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.748101 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.748188 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.748401 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.748488 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.748708 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.748804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.749035 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.749136 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.749309 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.749570 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.749690 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.750048 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.750137 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.750389 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.750511 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.750707 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.750810 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.751019 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.751114 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.751318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.751404 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.751628 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.751733 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.751933 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.752021 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.752235 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.752323 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.752548 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.752649 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.752853 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.752959 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.753157 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.753249 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.753458 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.753553 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.753763 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.753910 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.754091 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.754177 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.754391 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.754480 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.754696 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.754783 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.755000 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.755086 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.755314 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.755401 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.755615 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.755701 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.755920 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.756015 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.756219 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.756307 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.756519 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.756623 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.756825 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.756958 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.757130 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.757233 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.757430 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.757554 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.757728 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.758704 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.758704 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.759012 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.759164 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.759316 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.759593 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.760012 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.760211 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.760514 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.760675 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.760827 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.761044 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.761216 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.761439 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.761591 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.761739 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.762057 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.762236 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.762388 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.762588 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.762746 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.762982 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.763148 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.763317 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.763594 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.763757 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.763903 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.764184 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.764341 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.764569 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.764719 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.764867 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.765177 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.765385 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.765551 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.765742 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.765949 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.766127 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.766312 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.766477 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.766724 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.766902 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.767111 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.767338 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.767484 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.767630 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.767885 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.768041 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.768237 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.768426 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.768579 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.768837 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.769002 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.769152 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.769432 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.769588 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.769746 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.769988 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.770172 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.770402 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.770554 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.770729 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.771009 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.771165 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.771324 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.771569 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.771786 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.771936 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.772141 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.772306 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.772530 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.772700 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.772859 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.773143 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.773298 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.773459 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.773710 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.774068 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.774224 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.774380 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.774689 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.774907 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.775057 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.775231 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.775398 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.775595 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.775772 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.775938 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.776223 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.776376 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.776522 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.776784 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.776951 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.777154 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.777327 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.777479 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.777682 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.777909 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.778153 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.778412 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.778566 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.778767 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.778951 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.779103 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.779373 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.779526 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.779672 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.779946 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.780102 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.780289 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.780491 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.780644 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.780964 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.781119 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.781309 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.781498 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.781896 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.782045 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.782259 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.782412 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.782556 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.782779 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.782930 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.783150 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.783314 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.783471 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.783686 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.783862 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.784038 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.784218 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.784369 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.784659 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.784811 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.784973 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.785208 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.785392 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.785709 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.785909 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.786076 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.786390 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.786548 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.786748 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.786907 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.787052 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.787375 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.787588 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.787750 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.787896 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.788040 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.788308 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.788473 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.788619 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.788889 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.789136 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.789420 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.789576 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.789900 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.790052 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.790197 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.790448 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.790647 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.790817 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.791077 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.791242 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.791387 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.791671 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.791882 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.792045 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.792215 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.792420 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.792707 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.792900 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.793067 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.793242 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.793396 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.793675 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.793872 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.794021 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.794293 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.794449 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.794607 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.794842 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.795050 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.795212 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.795354 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.795500 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.795799 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.795973 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.796133 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.796362 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.796517 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.796704 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.796898 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.797053 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.797303 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.797464 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.797671 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.797950 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.798124 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.798273 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.798581 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.798735 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.798881 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.799116 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.799285 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.799511 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.799788 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.799944 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.800133 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.800330 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.800507 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.800733 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.800882 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.801038 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.801351 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.801518 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.801679 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.801928 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.802100 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.802327 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.802488 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.802647 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.802944 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.803104 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.803279 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.803492 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.803647 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.803920 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.804072 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.804218 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.804504 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.805158 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.805386 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.805643 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.805942 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.806152 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.806307 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.806474 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.806706 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.806862 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.807077 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.807228 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.807374 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.807684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.807850 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.807998 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.808242 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.808415 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.808593 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.808792 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.809010 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.809212 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.809407 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.809569 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.809837 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.810069 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.810250 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.810435 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.810639 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.810793 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.811064 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.811228 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.811377 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.811645 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.811802 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.812005 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.812199 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.812364 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.812627 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.812790 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.812937 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.813210 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.813419 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.813627 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.813874 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.814105 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.814266 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.814486 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.814650 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.814796 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.815104 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.815257 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.815403 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.815640 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.815959 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.816115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.816291 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.816589 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.816758 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.816906 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.817129 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.817284 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.817512 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.817661 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.817960 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.818152 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.818415 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.818566 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.818712 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.818868 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.819062 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.819266 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.819421 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.819709 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.819874 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.820030 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.820861 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.821112 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.821380 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.821538 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.821704 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.821989 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.822148 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.822316 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.822542 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.822698 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.822990 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.823142 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.823302 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.823546 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.823703 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.823917 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.824091 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.824245 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.824512 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.824669 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.824816 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.825085 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.825240 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.825427 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.825617 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.825770 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.826108 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.826259 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.826424 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.826714 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.826869 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.827048 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.827264 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.827420 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.827699 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.827961 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.828110 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.828321 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.828473 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.828630 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.828854 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.829156 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.829374 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.829543 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.829814 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.829965 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.830137 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.830434 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.830590 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.830777 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.830985 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.831140 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.831419 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.831583 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.831730 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.831997 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.832154 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.832329 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.832532 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.832686 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.832939 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.833099 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.833245 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.833528 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.833699 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.833888 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.834085 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.834239 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.834487 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.834655 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.835019 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.835172 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.835373 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.835522 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.835680 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.836114 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.836272 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.836497 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.836800 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.836970 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.837117 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.837353 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.837508 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.837739 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.837989 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.838139 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.838380 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.838551 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.838710 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.838938 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.839093 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.839283 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.839476 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.839627 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.840160 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.840325 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.840473 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.840741 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.840949 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.841148 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.841331 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.841516 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.841698 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.841924 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.842125 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.842312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.842494 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.842696 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.842881 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.843072 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.843271 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.843456 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.843650 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.843836 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.844054 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.844263 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.844445 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.844659 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.844845 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.845038 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.845219 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.845418 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.845613 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.845819 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.845970 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.846233 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.846388 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.846554 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.846808 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.846965 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.847143 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.847354 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.847510 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.847761 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.847922 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.848079 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.848364 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.848540 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.848704 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.848912 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.849067 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.849319 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.849481 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.849885 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.850226 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.850408 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.850552 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.850874 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.851030 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.851209 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.851542 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.851756 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.851906 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.852187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.852345 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.852542 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.852707 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.852855 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.853110 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.853265 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.853451 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.853654 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.853872 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.854088 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.854308 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.854497 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.854699 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.854891 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.855073 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.855297 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.855483 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.855667 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.855906 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.856106 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.856301 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.856509 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.856705 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.856900 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.857095 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.857291 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.857475 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.857651 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.857863 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.858258 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.859346 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.859513 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.859668 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.859814 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.859814 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.860100 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.860251 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.860251 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.860529 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.860675 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.860675 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.860966 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.861111 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.861111 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.861382 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.861541 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.861706 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.861897 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.861897 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.862213 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.862369 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.862544 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.862768 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.862920 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.863137 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.863289 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.863464 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.863729 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.863884 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.864088 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.864268 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.864422 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.864722 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.864984 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.865136 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.865279 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.865427 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.865688 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.865872 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.866039 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.866318 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.866458 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.866605 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.866881 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.867057 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.867772 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.868041 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.868326 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.868528 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.868691 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.868849 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.869047 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.869196 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.869357 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.869616 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.869820 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.869994 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.870199 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.870368 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.870516 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.870735 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.870903 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.871121 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.871282 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.871499 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.871725 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.871889 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.872048 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.872333 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.872604 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.872813 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.872963 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.873151 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.873319 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.873518 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.873720 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.873967 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.874142 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.874309 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.874480 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.874804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.874983 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.875130 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.875345 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.875513 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.875822 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.875975 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.876150 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.876375 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.876532 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.876780 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.876940 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.877101 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.877376 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.877532 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.877713 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.877947 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.878109 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.878378 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.878600 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.878760 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.878968 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.879199 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.879348 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.879536 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.879705 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.879897 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.880088 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.880250 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.880552 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.880708 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.880856 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.881101 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.881269 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.881482 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.881644 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.881831 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.882140 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.882443 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.882618 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.883359 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.883615 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.883768 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.884079 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.884251 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.884542 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.884697 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.884862 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.885111 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.885267 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.885468 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.885662 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.885859 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.886178 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.886336 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.886496 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.886729 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.886886 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.887126 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.887288 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.887434 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.887715 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.887885 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.888073 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.888266 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.888418 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.888746 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.888912 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.889059 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.889307 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.889464 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.889717 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.889910 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.890078 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.890336 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.890493 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.890649 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.890891 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.891067 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:24:57.891373 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.891783 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.892208 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.892632 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.893041 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.893451 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.893892 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.894306 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.894719 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.895126 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.895530 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.895943 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.896357 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.896759 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.897166 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.897572 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.898026 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.898716 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.899087 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.899545 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.899967 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.900372 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.900776 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.901197 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.901605 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.902065 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.902477 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.902883 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.903329 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.903749 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.904390 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.904823 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.905246 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.905676 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.906145 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.906554 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.906959 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.907362 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.907780 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.908196 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.908616 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.909025 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.909432 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.909880 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.910289 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.910695 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.911117 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.911524 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.911931 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.912338 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.912741 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.913152 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.913558 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.914052 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.914586 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.915005 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.915430 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.915890 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.916306 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.916715 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.917129 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.917535 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.917981 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.918406 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.918833 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.919266 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.919675 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.920193 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.920609 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.921022 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.921438 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.921925 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.922337 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.922755 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.923173 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.923588 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.923996 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.924421 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.924860 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.925292 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.925717 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.926155 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.926558 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.926960 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.927366 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.927786 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.928191 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.928599 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.928999 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.929414 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.930396 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.930868 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.931269 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.931669 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.932073 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.932470 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.932874 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.933289 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.933694 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.934156 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.934560 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.934968 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.935368 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.935779 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.936188 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.936622 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.937021 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.937458 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.937947 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.938363 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.938793 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.939203 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.939663 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.940077 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.940503 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.940929 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.941392 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.941814 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.942258 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.942668 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.943128 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.943537 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.943945 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.944388 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.944799 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.945254 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.946313 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.946813 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.947197 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.947617 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.948042 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.948463 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.948872 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.949300 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.949741 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.950202 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.950621 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.951037 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.951452 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.951866 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.952281 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.952691 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.953133 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.953556 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.954134 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.954574 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.954990 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.955418 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.955849 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.956297 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.956708 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.957154 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.957575 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.958039 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.958457 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.958864 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:24:57.959202 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:24:58.044235 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Registered counter for database nova_api Aug 29 21:24:58.066055 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.073113 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.113165 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO dbcounter [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Registered counter for database nova_api Aug 29 21:24:58.133592 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.context [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2(cell1) {{(pid=105414) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:24:58.133776 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_db.sqlalchemy.engines [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.137144 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:58.137629 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:58.139237 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:58.139980 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:58.140381 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writer thread running {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.140485 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:58.142452 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:58.144419 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Registered counter for database nova_cell0 Aug 29 21:24:58.148607 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Registered counter for database nova_cell1 Aug 29 21:24:58.156383 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.158672 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.163400 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.197508 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.context [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2(cell1) {{(pid=105413) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:24:58.201378 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_concurrency.lockutils [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:58.201869 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_concurrency.lockutils [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:58.203461 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_concurrency.lockutils [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:58.204251 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_concurrency.lockutils [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:24:58.204690 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_concurrency.lockutils [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:24:58.206763 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_concurrency.lockutils [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:24:58.208696 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO dbcounter [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Registered counter for database nova_cell0 Aug 29 21:24:58.214140 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO dbcounter [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Registered counter for database nova_cell1 Aug 29 21:24:58.221669 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_db.sqlalchemy.engines [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.223418 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_db.sqlalchemy.engines [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.229358 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writer thread running {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.232007 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writer thread running {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.306400 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.316310 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO dbcounter [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Registered counter for database nova_cell0 Aug 29 21:24:58.325423 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_db.sqlalchemy.engines [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.330106 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writer thread running {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.378794 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO dbcounter [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Registered counter for database nova_cell0 Aug 29 21:24:58.387806 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG oslo_db.sqlalchemy.engines [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:24:58.392174 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writer thread running {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:24:58.675655 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:24:58.683323 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:24:58.709573 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: WARNING keystonemiddleware.auth_token [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:24:58.717670 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: WARNING keystonemiddleware.auth_token [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:24:59.028503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:24:59.034494 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: WARNING keystonemiddleware.auth_token [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:24:59.040607 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a09d729c0 pid: 105414 (default app) Aug 29 21:24:59.042702 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:24:59.043908 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Aug 29 21:24:59.044303 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 788 bytes} [Mon Aug 29 21:24:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:24:59.061444 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: WARNING keystonemiddleware.auth_token [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:24:59.067531 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: WARNING keystonemiddleware.auth_token [None req-bed463fa-3dad-49ae-906b-abbf271190c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:24:59.072857 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a09d729c0 pid: 105413 (default app) Aug 29 21:26:17.869325 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:17.870510 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Aug 29 21:26:17.873409 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 2/2] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:17.882821 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writing DB stats nova_api:SELECT=3 {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.884273 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writing DB stats nova_cell1:SELECT=3 {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.885287 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writing DB stats nova_cell0:SELECT=3 {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:17.886190 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writing DB stats nova_cell0:SELECT=3 {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:18.754531 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-b357123a-2d37-4b9c-9b79-35c83791c932 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:18.788485 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-b357123a-2d37-4b9c-9b79-35c83791c932 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910783 Aug 29 21:26:18.789231 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 1/3] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 21:26:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:21.205868 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:21.206823 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-b4f07399-8813-4c37-b67c-34b0aeb942f0 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 29 21:26:21.207409 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 3/4] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:21.653234 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-5068d163-caeb-43bb-857a-54c8a258d84e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:21.700882 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-5068d163-caeb-43bb-857a-54c8a258d84e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487056 Aug 29 21:26:21.701448 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 2/5] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:21.715756 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=3 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.717086 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell0:SELECT=3 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.718078 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell1:SELECT=3 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.719045 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:21.925176 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2d985fe2-02cb-4969-b99a-8e8e3aa41008 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:21.995307 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2d985fe2-02cb-4969-b99a-8e8e3aa41008 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284779 Aug 29 21:26:21.995812 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 4/6] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 21:26:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:24.375883 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-5068d163-caeb-43bb-857a-54c8a258d84e admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:24.376810 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-5068d163-caeb-43bb-857a-54c8a258d84e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 29 21:26:24.377204 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 3/7] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:25.052175 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-312e821e-f435-4740-b0c2-5b4dac3dc6c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:25.093884 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-312e821e-f435-4740-b0c2-5b4dac3dc6c5 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.709625 Aug 29 21:26:25.102256 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 5/8] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:26:25.107662 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-55e184f1-5a83-4f1d-95ad-e0bb91390dbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:25.145847 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-55e184f1-5a83-4f1d-95ad-e0bb91390dbf admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041550 Aug 29 21:26:25.154762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 4/9] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 21:26:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:27.609976 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-312e821e-f435-4740-b0c2-5b4dac3dc6c5 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:27.611012 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-312e821e-f435-4740-b0c2-5b4dac3dc6c5 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Aug 29 21:26:27.611419 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 6/10] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:28.010911 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-20642cae-f9ed-4443-a476-02628d8a4781 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "ram": 1024, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:28.029982 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-20642cae-f9ed-4443-a476-02628d8a4781 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.411614 Aug 29 21:26:28.030783 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 5/11] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:28.043706 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-c63dd002-b4ed-473f-a7ae-98008c808a27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:28.068531 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-c63dd002-b4ed-473f-a7ae-98008c808a27 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028766 Aug 29 21:26:28.069111 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 7/12] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 21:26:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:30.495741 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-20642cae-f9ed-4443-a476-02628d8a4781 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:30.496828 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-20642cae-f9ed-4443-a476-02628d8a4781 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 29 21:26:30.497167 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 6/13] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:30.967768 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-85b180b5-5d4f-46af-8e88-1b3ef947a77f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:30.987997 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-85b180b5-5d4f-46af-8e88-1b3ef947a77f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484146 Aug 29 21:26:30.989222 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 8/14] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:31.001303 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-48d7b029-ff0a-4b01-8457-1d17f3e362a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:31.034269 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-48d7b029-ff0a-4b01-8457-1d17f3e362a0 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036481 Aug 29 21:26:31.038122 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 7/15] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 21:26:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:33.453198 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-85b180b5-5d4f-46af-8e88-1b3ef947a77f admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:33.454210 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-85b180b5-5d4f-46af-8e88-1b3ef947a77f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 29 21:26:33.454574 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 9/16] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:33.909286 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-0d32b597-7c0a-42f5-9ca2-2492fbb50915 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:33.929824 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-0d32b597-7c0a-42f5-9ca2-2492fbb50915 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468629 Aug 29 21:26:33.931035 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 8/17] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:33.943442 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-66f95dc8-4c9e-4c55-ad19-dea5e753a2d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:33.968129 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-66f95dc8-4c9e-4c55-ad19-dea5e753a2d4 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029138 Aug 29 21:26:33.969091 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 10/18] 10.222.0.90 () {64 vars in 1336 bytes} [Mon Aug 29 21:26:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:36.294368 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-0d32b597-7c0a-42f5-9ca2-2492fbb50915 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:36.295393 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-0d32b597-7c0a-42f5-9ca2-2492fbb50915 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 29 21:26:36.295788 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 9/19] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:36.742893 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-e76623ee-5d02-4ec8-b35c-a77adc2e58e0 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:36.767865 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-e76623ee-5d02-4ec8-b35c-a77adc2e58e0 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465336 Aug 29 21:26:36.768404 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 11/20] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 21:26:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:26:39.141673 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-0d32b597-7c0a-42f5-9ca2-2492fbb50915 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:39.142739 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-0d32b597-7c0a-42f5-9ca2-2492fbb50915 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 29 21:26:39.143145 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 10/21] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:39.589505 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-431e4d7b-b94f-45a6-8af7-90eef6bc5ebd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "id": "1", "name": "m1.tiny"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:39.608412 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-431e4d7b-b94f-45a6-8af7-90eef6bc5ebd admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.458779 Aug 29 21:26:39.608960 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 12/22] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:26:39.621608 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-5ac59c37-6e90-421e-a7c5-b7c936bb2263 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:39.646440 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-5ac59c37-6e90-421e-a7c5-b7c936bb2263 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028449 Aug 29 21:26:39.646996 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 11/23] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 21:26:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:41.995124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-431e4d7b-b94f-45a6-8af7-90eef6bc5ebd admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:41.996145 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-431e4d7b-b94f-45a6-8af7-90eef6bc5ebd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 29 21:26:41.996545 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 13/24] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:42.408489 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-f3a98660-d93c-40de-bb0b-1067ad915496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:42.427401 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-f3a98660-d93c-40de-bb0b-1067ad915496 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424757 Aug 29 21:26:42.428070 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 12/25] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:42.441806 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-9d675233-0f4b-4f4b-ac1f-f903f8c59716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:42.469488 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-9d675233-0f4b-4f4b-ac1f-f903f8c59716 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031970 Aug 29 21:26:42.470120 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 14/26] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 21:26:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:44.849009 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-f3a98660-d93c-40de-bb0b-1067ad915496 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:44.850826 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-f3a98660-d93c-40de-bb0b-1067ad915496 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002254 Aug 29 21:26:44.851307 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 13/27] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:45.337336 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2f60ca74-abd8-4177-aafb-78462ad42f5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "vcpus": 2, "disk": 40, "name": "m1.medium"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:45.359120 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2f60ca74-abd8-4177-aafb-78462ad42f5d admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.500389 Aug 29 21:26:45.360177 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 15/28] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:45.372499 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-5ceb9866-15a3-47d6-9aad-849d3ce52009 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:45.401894 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-5ceb9866-15a3-47d6-9aad-849d3ce52009 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033042 Aug 29 21:26:45.402469 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 14/29] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 21:26:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:47.829852 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-2f60ca74-abd8-4177-aafb-78462ad42f5d admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:47.831400 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-2f60ca74-abd8-4177-aafb-78462ad42f5d admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 29 21:26:47.832179 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 16/30] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:48.355122 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-e59d55a9-fb80-4baa-a5cc-7693c23057b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "name": "m1.large"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:48.363272 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:48.379944 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-e59d55a9-fb80-4baa-a5cc-7693c23057b4 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.541369 Aug 29 21:26:48.380592 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 15/31] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:48.392800 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-431629e1-a5a1-4a9d-8d8b-d4c0bad7fa6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:48.422228 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-431629e1-a5a1-4a9d-8d8b-d4c0bad7fa6e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032998 Aug 29 21:26:48.422800 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 17/32] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 21:26:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:50.895938 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-e59d55a9-fb80-4baa-a5cc-7693c23057b4 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:26:50.896947 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-e59d55a9-fb80-4baa-a5cc-7693c23057b4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 29 21:26:50.897562 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 16/33] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:26:51.364163 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-35e99f55-25af-476f-85b2-245f4e538616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "ram": 16384, "disk": 160, "rxtx_factor": 1.0}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:51.384184 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-35e99f55-25af-476f-85b2-245f4e538616 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.480542 Aug 29 21:26:51.386318 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 18/34] 10.222.0.90 () {64 vars in 1283 bytes} [Mon Aug 29 21:26:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:26:51.397507 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-12dcf1bb-c61e-4b62-ad15-2e886bf5a521 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:26:51.436604 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-12dcf1bb-c61e-4b62-ad15-2e886bf5a521 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043504 Aug 29 21:26:51.437112 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 17/35] 10.222.0.90 () {64 vars in 1333 bytes} [Mon Aug 29 21:26:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:10.782918 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-35e99f55-25af-476f-85b2-245f4e538616 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:10.784156 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-35e99f55-25af-476f-85b2-245f4e538616 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Aug 29 21:27:10.784562 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 19/36] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:27:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:10.794996 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.178253 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7bf59df0-a75e-4218-a711-3a6583bac1b3 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:11.196819 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7bf59df0-a75e-4218-a711-3a6583bac1b3 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406220 Aug 29 21:27:11.197345 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 18/37] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 21:27:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:12.276301 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-35e99f55-25af-476f-85b2-245f4e538616 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.277315 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-35e99f55-25af-476f-85b2-245f4e538616 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 29 21:27:12.277712 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 20/38] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:12.808337 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-27082dd6-e004-4492-8262-6e5192f459a7 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.814862 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.wsgi [None req-27082dd6-e004-4492-8262-6e5192f459a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-27082dd6-e004-4492-8262-6e5192f459a7 admin admin] Request method failure captured: Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Accept: application/json Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Accept-Encoding: gzip, deflate Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Connection: keep-alive Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Content-Length: 0 Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Host: 10.222.0.90 Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Openstack-System-Scope: None Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: User-Agent: python-novaclient Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Auth-Token: gAAAAABjDS8wsekAU_7P7Xxv2EPzuyR0S1KYhwqfrVesP-Vop7e0BZkbw_gHzrAg0dwel-UuuNL-eaFo1aLKsnLprRjanHFkLOP4dLEyAbPXR_5nBjaX0X0itV9Bd2l02SUNUAGcT2WtPZ05Fbuj25rPnEKX42JcXlT60zk_XWqThHdqQSgcMQM Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Domain-Id: None Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Domain-Name: None Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Identity-Status: Confirmed Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Is-Admin-Project: True Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Domain-Id: default Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Domain-Name: Default Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Name: admin Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Role: reader,member,admin Aug 29 21:27:12.818318 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Roles: reader,member,admin Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fa1ebaa0d49241599f614eb2efe4d8c8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant: admin Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant-Name: admin Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User: admin Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Domain-Id: default Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Domain-Name: Default Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Id: 97a0b159abf44cd59fe5a2b7bde28adf Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Name: admin Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: method: > Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: exception: Flavor 42 could not be found. Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: action_args: {'id': '42'} Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:12.820115 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:12.821187 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.822737 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-27082dd6-e004-4492-8262-6e5192f459a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:12.824072 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-27082dd6-e004-4492-8262-6e5192f459a7 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403174 Aug 29 21:27:12.824072 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 19/39] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:12.829498 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-96e1044d-d1b8-4604-9818-0c6bffabe016 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.833701 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.855957 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-96e1044d-d1b8-4604-9818-0c6bffabe016 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030005 Aug 29 21:27:12.856512 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 21/40] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:12.867129 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-c087938e-b0ff-4aab-8415-23b43b04c0f2 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.893131 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-c087938e-b0ff-4aab-8415-23b43b04c0f2 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029520 Aug 29 21:27:12.893680 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 20/41] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:12.903725 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-0b39d595-b4af-4093-aa93-e52468c8fed1 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:12.909633 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.wsgi [None req-0b39d595-b4af-4093-aa93-e52468c8fed1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-0b39d595-b4af-4093-aa93-e52468c8fed1 admin admin] Request method failure captured: Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Accept: application/json Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Accept-Encoding: gzip, deflate Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Connection: keep-alive Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Content-Length: 0 Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Host: 10.222.0.90 Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Openstack-System-Scope: None Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: User-Agent: python-novaclient Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Auth-Token: gAAAAABjDS8wsekAU_7P7Xxv2EPzuyR0S1KYhwqfrVesP-Vop7e0BZkbw_gHzrAg0dwel-UuuNL-eaFo1aLKsnLprRjanHFkLOP4dLEyAbPXR_5nBjaX0X0itV9Bd2l02SUNUAGcT2WtPZ05Fbuj25rPnEKX42JcXlT60zk_XWqThHdqQSgcMQM Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Domain-Id: None Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Domain-Name: None Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Identity-Status: Confirmed Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Is-Admin-Project: True Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Domain-Id: default Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Domain-Name: Default Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Name: admin Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Role: reader,member,admin Aug 29 21:27:12.912879 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Roles: reader,member,admin Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fa1ebaa0d49241599f614eb2efe4d8c8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant: admin Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant-Name: admin Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User: admin Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Domain-Id: default Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Domain-Name: Default Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Id: 97a0b159abf44cd59fe5a2b7bde28adf Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Name: admin Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: method: > Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: exception: Flavor 42 could not be found. Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: action_args: {'id': '42'} Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:12.914312 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:12.918350 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:12.919684 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-0b39d595-b4af-4093-aa93-e52468c8fed1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:12.920915 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-0b39d595-b4af-4093-aa93-e52468c8fed1 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014603 Aug 29 21:27:12.920915 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 22/42] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 21:27:13.905270 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-c087938e-b0ff-4aab-8415-23b43b04c0f2 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:13.906323 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-c087938e-b0ff-4aab-8415-23b43b04c0f2 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 29 21:27:13.907014 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 21/43] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:14.442360 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-18aca790-1559-46e0-8e72-044360587ace admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.447719 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.wsgi [None req-18aca790-1559-46e0-8e72-044360587ace admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-18aca790-1559-46e0-8e72-044360587ace admin admin] Request method failure captured: Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Accept: application/json Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Accept-Encoding: gzip, deflate Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Connection: keep-alive Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Content-Length: 0 Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Host: 10.222.0.90 Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Openstack-System-Scope: None Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: User-Agent: python-novaclient Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Auth-Token: gAAAAABjDS8xWCdYZH5I0IbOnjbynO4FKfjtIeH0-LATkdPIH6--jwaWAFr8LQEd8_jL8h8P76d_s9bDSJSw1lx4sHYzgLNiTuW5FUkxaiRCyORrHNNUQhtTEsKAquONaKEv7Tvh1Kti7GBADHJyHA9bp-hyzSTfDS4Pih1Y0A-Cu-HHab3N1sU Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Domain-Id: None Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Domain-Name: None Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Identity-Status: Confirmed Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Is-Admin-Project: True Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Domain-Id: default Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Domain-Name: Default Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Name: admin Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Role: reader,member,admin Aug 29 21:27:14.449220 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Roles: reader,member,admin Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fa1ebaa0d49241599f614eb2efe4d8c8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant: admin Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant-Name: admin Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User: admin Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Domain-Id: default Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Domain-Name: Default Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Id: 97a0b159abf44cd59fe5a2b7bde28adf Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Name: admin Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: method: > Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: exception: Flavor 84 could not be found. Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: action_args: {'id': '84'} Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:14.450792 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:14.451804 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.453124 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-18aca790-1559-46e0-8e72-044360587ace admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:14.454444 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-18aca790-1559-46e0-8e72-044360587ace admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.403192 Aug 29 21:27:14.454444 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 23/44] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:14.460271 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-d8151b98-11a5-473f-907d-964848dd4836 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.477133 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-d8151b98-11a5-473f-907d-964848dd4836 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020256 Aug 29 21:27:14.477886 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 22/45] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:14.488126 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-e57d25af-c709-4902-a2b4-abfadee0c77f admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.502958 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-e57d25af-c709-4902-a2b4-abfadee0c77f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018997 Aug 29 21:27:14.503469 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 24/46] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:14.512694 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-9d8b4d28-5989-4b8c-8912-56e60adbaa27 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:14.518137 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.wsgi [None req-9d8b4d28-5989-4b8c-8912-56e60adbaa27 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-9d8b4d28-5989-4b8c-8912-56e60adbaa27 admin admin] Request method failure captured: Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Accept: application/json Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Accept-Encoding: gzip, deflate Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Connection: keep-alive Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Content-Length: 0 Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Host: 10.222.0.90 Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Openstack-System-Scope: None Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: User-Agent: python-novaclient Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Auth-Token: gAAAAABjDS8xWCdYZH5I0IbOnjbynO4FKfjtIeH0-LATkdPIH6--jwaWAFr8LQEd8_jL8h8P76d_s9bDSJSw1lx4sHYzgLNiTuW5FUkxaiRCyORrHNNUQhtTEsKAquONaKEv7Tvh1Kti7GBADHJyHA9bp-hyzSTfDS4Pih1Y0A-Cu-HHab3N1sU Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Domain-Id: None Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Domain-Name: None Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Identity-Status: Confirmed Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Is-Admin-Project: True Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Domain-Id: default Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Domain-Name: Default Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Name: admin Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Role: reader,member,admin Aug 29 21:27:14.519637 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Roles: reader,member,admin Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fa1ebaa0d49241599f614eb2efe4d8c8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant: admin Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant-Name: admin Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User: admin Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Domain-Id: default Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Domain-Name: Default Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Id: 97a0b159abf44cd59fe5a2b7bde28adf Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Name: admin Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: method: > Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: exception: Flavor 84 could not be found. Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: action_args: {'id': '84'} Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:14.521175 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:14.522189 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:14.523856 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-9d8b4d28-5989-4b8c-8912-56e60adbaa27 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:14.525117 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-9d8b4d28-5989-4b8c-8912-56e60adbaa27 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011792 Aug 29 21:27:14.525117 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 23/47] 10.222.0.90 () {60 vars in 1190 bytes} [Mon Aug 29 21:27:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:15.556054 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-e57d25af-c709-4902-a2b4-abfadee0c77f admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:15.557049 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-e57d25af-c709-4902-a2b4-abfadee0c77f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 29 21:27:15.557491 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 25/48] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:16.141148 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-0a154a79-803c-47ad-be9b-6c2ae1876011 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:16.148244 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.wsgi [None req-0a154a79-803c-47ad-be9b-6c2ae1876011 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-0a154a79-803c-47ad-be9b-6c2ae1876011 admin admin] Request method failure captured: Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Accept: application/json Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Accept-Encoding: gzip, deflate Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Connection: keep-alive Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Content-Length: 0 Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Host: 10.222.0.90 Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Openstack-System-Scope: None Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: User-Agent: python-novaclient Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Auth-Token: gAAAAABjDS8z8_UOtU3SAxVQcIUJN9oRrAalnOO6nfMgbrouI-kzsvW7gellipDhhdPouPDiNygDoruePkXW75Zm-Zof8up28kpiv_DQEc6ISV3kFl2CrWzf6AXzvFv39ncx-h9PlzI3qBk-VTyWIUKhcPYGnc64_KCjRogSf88cx6o_BzPsQiE Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Domain-Id: None Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Domain-Name: None Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Identity-Status: Confirmed Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Is-Admin-Project: True Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Domain-Id: default Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Domain-Name: Default Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Project-Name: admin Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Role: reader,member,admin Aug 29 21:27:16.149762 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Roles: reader,member,admin Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fa1ebaa0d49241599f614eb2efe4d8c8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant: admin Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-Tenant-Name: admin Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User: admin Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Domain-Id: default Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Domain-Name: Default Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Id: 97a0b159abf44cd59fe5a2b7bde28adf Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: X-User-Name: admin Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: method: > Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: exception: Flavor 451 could not be found. Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: action_args: {'id': '451'} Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:16.151339 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:16.152513 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.153991 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-0a154a79-803c-47ad-be9b-6c2ae1876011 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:16.155283 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-0a154a79-803c-47ad-be9b-6c2ae1876011 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.453799 Aug 29 21:27:16.155283 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 21:27:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 455 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:16.162775 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-16fa8f99-fc56-49e5-b056-8af87c47a3ac admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:16.178450 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-16fa8f99-fc56-49e5-b056-8af87c47a3ac admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019359 Aug 29 21:27:16.178988 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 26/50] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:16.188785 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:16.206374 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021145 Aug 29 21:27:16.206918 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 25/51] 10.222.0.90 () {60 vars in 1210 bytes} [Mon Aug 29 21:27:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:27:16.217360 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-9126b400-4993-4e62-9031-238e286decca admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:16.224044 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.wsgi [None req-9126b400-4993-4e62-9031-238e286decca admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-9126b400-4993-4e62-9031-238e286decca admin admin] Request method failure captured: Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Accept: application/json Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Accept-Encoding: gzip, deflate Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Connection: keep-alive Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Content-Length: 0 Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Host: 10.222.0.90 Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Openstack-Api-Version: compute 2.90 Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Openstack-System-Scope: None Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: User-Agent: python-novaclient Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Auth-Token: gAAAAABjDS8z8_UOtU3SAxVQcIUJN9oRrAalnOO6nfMgbrouI-kzsvW7gellipDhhdPouPDiNygDoruePkXW75Zm-Zof8up28kpiv_DQEc6ISV3kFl2CrWzf6AXzvFv39ncx-h9PlzI3qBk-VTyWIUKhcPYGnc64_KCjRogSf88cx6o_BzPsQiE Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Domain-Id: None Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Domain-Name: None Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Identity-Status: Confirmed Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Is-Admin-Project: True Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Domain-Id: default Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Domain-Name: Default Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Project-Name: admin Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Role: reader,member,admin Aug 29 21:27:16.225743 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Roles: reader,member,admin Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fa1ebaa0d49241599f614eb2efe4d8c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fa1ebaa0d49241599f614eb2efe4d8c8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant: admin Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant-Id: fa1ebaa0d49241599f614eb2efe4d8c8 Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-Tenant-Name: admin Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User: admin Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Domain-Id: default Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Domain-Name: Default Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Id: 97a0b159abf44cd59fe5a2b7bde28adf Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: X-User-Name: admin Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: method: > Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: exception: Flavor 451 could not be found. Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: action_args: {'id': '451'} Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:27:16.227503 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:16.228430 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: ERROR nova.api.openstack.wsgi Aug 29 21:27:16.229669 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-9126b400-4993-4e62-9031-238e286decca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:27:16.230985 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-9126b400-4993-4e62-9031-238e286decca admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014009 Aug 29 21:27:16.230985 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 27/52] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 21:27:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:27:17.240687 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:17.241678 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 29 21:27:17.242091 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 26/53] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:17.779719 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-c062028c-4660-4edb-b7db-571e8c83ae56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:17.799316 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-c062028c-4660-4edb-b7db-571e8c83ae56 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.418367 Aug 29 21:27:17.799853 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 28/54] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 21:27:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:18.869668 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:18.870706 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 29 21:27:18.871090 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 27/55] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:19.446830 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-c016176f-4e75-4df4-a23a-58e4d6815685 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:19.467696 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-c016176f-4e75-4df4-a23a-58e4d6815685 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.451179 Aug 29 21:27:19.468236 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 29/56] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 21:27:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:20.514159 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:20.515182 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 29 21:27:20.515564 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 28/57] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:21.096735 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-addc9060-6daa-4ad4-a4ae-703fdc243601 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:21.117349 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-addc9060-6daa-4ad4-a4ae-703fdc243601 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.459511 Aug 29 21:27:21.118037 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 30/58] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 21:27:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:22.109844 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:22.110813 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 29 21:27:22.111362 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 29/59] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:22.640224 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-c059fab2-68ed-4827-bd0d-601392b17ffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:27:22.660573 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-c059fab2-68ed-4827-bd0d-601392b17ffd admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409775 Aug 29 21:27:22.661047 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 31/60] 10.222.0.90 () {64 vars in 1235 bytes} [Mon Aug 29 21:27:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:27:23.641120 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:23.642283 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 29 21:27:23.643485 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 30/61] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:27:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:27:24.191328 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-756fbbf9-a984-4452-9312-967b3f07405e admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:27:24.227739 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-756fbbf9-a984-4452-9312-967b3f07405e admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.443385 Aug 29 21:27:24.228729 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1202 bytes} [Mon Aug 29 21:27:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:20.917401 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:20.918468 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-7eeb3b5d-5a7d-44cb-80d1-fb57f4b674bd admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 29 21:28:20.918864 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 31/63] 10.222.0.90 () {54 vars in 931 bytes} [Mon Aug 29 21:28:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:28:20.929393 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:21.318401 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-5f2a0bb7-5589-41f2-a445-d88f76b2ec98 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:21.339071 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-5f2a0bb7-5589-41f2-a445-d88f76b2ec98 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414066 Aug 29 21:28:21.339599 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 33/64] 10.222.0.90 () {60 vars in 1292 bytes} [Mon Aug 29 21:28:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:28:21.363332 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG dbcounter [-] [105413] Writing DB stats nova_api:SELECT=14 {{(pid=105413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:21.367118 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-3515d25d-7cee-4cf2-bf94-1de0540329f5 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:21.374977 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-3515d25d-7cee-4cf2-bf94-1de0540329f5 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013859 Aug 29 21:28:21.375491 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 32/65] 10.222.0.90 () {60 vars in 1283 bytes} [Mon Aug 29 21:28:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:21.387489 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-bcac080a-3af1-4fa9-a91d-5e3f1ae43df8 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:21.395702 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-bcac080a-3af1-4fa9-a91d-5e3f1ae43df8 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011893 Aug 29 21:28:21.396269 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 34/66] 10.222.0.90 () {60 vars in 1286 bytes} [Mon Aug 29 21:28:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:21.408618 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:21.416760 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012167 Aug 29 21:28:21.417233 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 33/67] 10.222.0.90 () {60 vars in 1286 bytes} [Mon Aug 29 21:28:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:21.429614 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-d0505215-ccab-4eff-9104-599a908094ac admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:28:21.437335 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-d0505215-ccab-4eff-9104-599a908094ac admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011414 Aug 29 21:28:21.437870 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 35/68] 10.222.0.90 () {60 vars in 1283 bytes} [Mon Aug 29 21:28:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:31:28.700673 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:28.702879 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002717 Aug 29 21:31:28.703460 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 34/69] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:28.853497 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=6 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:29.070404 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:29.074575 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:29.075060 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:29.076063 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:29.076974 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:29.077468 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:29.078000 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:29.114944 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-34fef8d8-5e07-43bc-8813-3d66a81eab8a admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.262873 Aug 29 21:31:29.115515 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 36/70] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 21:31:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:31:30.043950 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:30.044953 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 29 21:31:30.045380 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 35/71] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:30.265486 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:30.270854 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:30.271561 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:30.272038 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:30.273054 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:30.273808 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:30.274446 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:30.296403 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-98fcad94-45e7-488d-9c98-fc7d5a0547f2 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.099267 Aug 29 21:31:30.297034 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 37/72] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 21:31:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:31:41.633206 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:41.634484 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 29 21:31:41.634935 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 36/73] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:31:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:31:41.790309 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell0:SELECT=4 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:41.791538 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_cell1:SELECT=4 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:41.792537 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG dbcounter [-] [105414] Writing DB stats nova_api:SELECT=8 {{(pid=105414) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:41.859829 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:41.865665 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.866933 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.867640 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.868833 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:41.869560 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:41.870318 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:41.915628 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-38298e9f-a3fc-44a4-8009-1d61902eedd0 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.132953 Aug 29 21:31:41.916589 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 38/74] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 21:31:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:31:42.846794 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: DEBUG nova.api.openstack.wsgi [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] Calling method '>' {{(pid=105413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:42.847806 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: INFO nova.api.openstack.requestlog [None req-a0ca2398-0ddf-4dc8-b63a-2be190d55ad2 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 29 21:31:42.848197 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: [pid: 105413|app: 0|req: 37/75] 10.222.0.90 () {56 vars in 1074 bytes} [Mon Aug 29 21:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:31:43.080230 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG nova.api.openstack.wsgi [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] Calling method '>' {{(pid=105414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:31:43.083632 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.084110 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.084690 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.085402 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:31:43.085867 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:31:43.086279 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: DEBUG oslo_concurrency.lockutils [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:31:43.110582 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: INFO nova.api.openstack.requestlog [None req-8dcb67ab-fdd0-4588-b3fc-0b3e6b600409 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093562 Aug 29 21:31:43.111157 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: [pid: 105414|app: 0|req: 39/76] 10.222.0.90 () {60 vars in 1193 bytes} [Mon Aug 29 21:31:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:32:41.643183 dv-cinder-854267-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 21:32:41.643828 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: Mon Aug 29 21:32:41 2022 - graceful shutdown triggered... Aug 29 21:32:41.644783 dv-cinder-854267-3-iscsi devstack@n-api.service[105413]: Gracefully killing worker 1 (pid: 105413)... Aug 29 21:32:41.645317 dv-cinder-854267-3-iscsi devstack@n-api.service[105414]: Gracefully killing worker 2 (pid: 105414)... Aug 29 21:32:42.645656 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: worker 1 buried after 1 seconds Aug 29 21:32:42.645656 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: worker 2 buried after 1 seconds Aug 29 21:32:42.645656 dv-cinder-854267-3-iscsi devstack@n-api.service[105412]: goodbye to uWSGI. Aug 29 21:32:42.647385 dv-cinder-854267-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 21:32:42.648199 dv-cinder-854267-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 21:32:42.652907 dv-cinder-854267-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:32:42.665879 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:32:42 2022] *** Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: nodename: dv-cinder-854267-3-iscsi Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: machine: x86_64 Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: clock source: unix Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: pcre jit disabled Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: detected number of CPU cores: 4 Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: current working directory: / Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: your processes number limit is 47680 Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: your memory page size is 4096 bytes Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: detected max file descriptor number: 2048 Aug 29 21:32:42.669877 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: lock engine: pthread robust mutexes Aug 29 21:32:42.671128 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: thunder lock: enabled Aug 29 21:32:42.671128 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:32:42.671128 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:32:42.710784 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: Python main interpreter initialized at 0x55adb40c79c0 Aug 29 21:32:42.710784 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: python threads support enabled Aug 29 21:32:42.710784 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: your server socket listen backlog is limited to 100 connections Aug 29 21:32:42.710784 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:32:42.711292 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:32:42.711292 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: *** Operational MODE: preforking *** Aug 29 21:32:42.711523 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:32:42.711523 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: spawned uWSGI master process (pid: 127052) Aug 29 21:32:42.711790 dv-cinder-854267-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:32:42.712863 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: spawned uWSGI worker 1 (pid: 127068, cores: 1) Aug 29 21:32:42.712863 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: spawned uWSGI worker 2 (pid: 127069, cores: 1) Aug 29 21:32:42.712863 dv-cinder-854267-3-iscsi devstack@n-api.service[127052]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:32:43.478331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:32:43.638940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:32:44.930883 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:32:44.930883 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: from cryptography.utils import int_from_bytes Aug 29 21:32:44.932627 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:32:44.932627 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: from cryptography.utils import int_from_bytes Aug 29 21:32:44.952280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:32:44.952280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: from cryptography.utils import int_from_bytes Aug 29 21:32:44.953169 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:32:44.953169 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: from cryptography.utils import int_from_bytes Aug 29 21:32:47.605430 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:32:47.606315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:32:47.606732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:32:47.607355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:32:47.607787 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:32:47.608366 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.608710 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.609046 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.609526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.610423 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.610863 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.611437 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.611842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.612230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.612564 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.612830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.613133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-3-iscsi {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.613541 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.613903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.614229 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.614574 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.614868 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.615201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.615521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.616039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.618260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.618260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.618260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.618260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.618260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.618260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.619118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.619118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.619118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.620116 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.621025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-3-iscsi {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.621400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.621853 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.622249 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.622590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.623003 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.623303 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.623668 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.624015 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.624015 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.624688 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.624688 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.625487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.625487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.626237 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.626237 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.626827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.626827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.627327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.627327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.627768 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.628042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.628615 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.628615 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.629086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.629426 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.629426 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.629901 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.630144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.631293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.631293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.631293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.631293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.632199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.632199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.632199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.632864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.632864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.633985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.633985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.634454 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.634896 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.635668 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.636315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.636879 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.637486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.638095 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.638563 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.639023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.639550 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.639957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.640283 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.641496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.641496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.641496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.642493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.642493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.642493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.642493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.643914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.643914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.643914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.643914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.645377 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.645377 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.645377 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.645377 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.645377 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.646651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.646651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.646651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.646651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.649514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.652617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.656178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.658579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.660339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.663215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.665754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.668025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.669823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.671498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.671498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.671498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.672956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.672956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.672956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.672956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.674877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.674877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.674877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.674877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.676017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.676017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.676017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.676682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.676682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.677088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.677321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.677546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.677946 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.678524 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.679114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.679579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.680101 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.680433 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.680855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.681276 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.681639 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.683253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.683253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.683253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.683935 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.683935 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.684364 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.684643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.685375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.685375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.686077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.686383 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.686729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.687411 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.687669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.688253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.688596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.689059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.689623 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.690190 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.690997 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.691468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.692076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.692666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.693287 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.693874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.694311 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.694710 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.695535 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.695535 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.696226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.696717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.697292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.698126 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.698713 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.699293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.699728 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.700062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.700391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.700716 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.701042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.701409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.701729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.702113 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.702738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.702998 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.703256 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.703972 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.703972 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.704432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.704432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.704903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.705135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.705705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.705705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.706557 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.706557 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.707147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.707395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.707789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.708214 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.708799 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.709559 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.709855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.710108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.710387 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.710715 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.711041 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.712147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.712147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.712584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.713053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.713707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.714550 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.715100 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.715838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.716320 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.716715 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.717249 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.717727 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.718286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.718855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.719218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.719755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.720283 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.720874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.721404 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.721852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.722531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.723198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.723643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.723882 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.724425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.725139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.725139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.725613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.726168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.726664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.726982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.727435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.727977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.728531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.729414 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.730192 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.730790 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.731273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.731658 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.732234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.732743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.733209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.733530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.734090 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.734678 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.735408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.735572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.735909 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.736470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.737140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.737431 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.739262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.739262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.739262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.739973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.740131 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.749005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.750908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.752604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.752604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.752604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.752604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.752604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.753363 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.753623 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.753976 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.754468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.755013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.755561 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.756028 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.756500 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.757058 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.758573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.758573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.758884 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.759160 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.759706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.760941 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.761481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.762099 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.762887 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.763706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.764497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.765275 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.766117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.766815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.767630 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.768395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.769031 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.769745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.770535 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.771299 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.771995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.772779 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.773424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.773955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.774559 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.775227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.781810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.782569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.782569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.782569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.782852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.783328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.783819 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.784291 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.784753 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.785228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.785712 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.786204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.786705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.787183 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.787671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.788260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.788750 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.789229 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.789715 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.790218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.790695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.791167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.792183 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.792679 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.793172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.793643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.794122 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.794613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.795096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.795582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.796063 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.796552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.797019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.798268 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.798738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.799207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.799763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.800282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.800770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.801230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.801697 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.802190 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.802713 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.803210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.803780 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.804390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.804920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.805469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.806120 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.806667 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.807785 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.808446 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.808961 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.809483 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.810728 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.811247 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.811764 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.812300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.812805 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.813329 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.813877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.814417 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.814942 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.815451 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.816015 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.816582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.817149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.817548 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.817995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.818427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.818827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.819219 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.819622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.820013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.820407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.820742 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.821067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.821388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.821729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.822078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.822395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.823297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.823562 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.823885 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.824199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.824658 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.824984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.825304 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.825620 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.825971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.826290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.826624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.826953 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.827272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.827783 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.828108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.828431 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.828756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.829069 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.829451 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.829859 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.830398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.830920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.831244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.832281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.832281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.832576 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.833066 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.833629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.834093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.834527 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.835014 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.835589 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.835991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.836354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.836693 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.837069 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.837548 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.837943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.838988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.839586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.842242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.842242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.842242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.842242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.842242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.842242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.842242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.843308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.843308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.843308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.843898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.844991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.845356 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.845686 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.846039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.846378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.846707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.847032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.847375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.847695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.848041 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.848350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.848674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.849052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.849308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.849643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.850129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.850452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.850780 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.851114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.851491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.851890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.852086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.852444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.852763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.853078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.853394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.856360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.856360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.856360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.856360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.856360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.856360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.856360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.858703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.858703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.858703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.858703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.858703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.858703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.858703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.859949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.859949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.859949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.859949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.859949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.865006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.867343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.868971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.871330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.871330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.871330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.871330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.871330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.871330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.871330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.872702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.872702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.872702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.872702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.872702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.873665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.873665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.873665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.874276 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.874485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.874700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.874922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.875250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.875619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.875939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.876250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.876566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.876885 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.877205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.877560 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.877873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.878197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.878545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.878832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.879147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.879463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.879779 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.880115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.880454 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.880779 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.881099 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.881418 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.881742 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.882348 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.882665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.883006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.883335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.883662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.883986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.884309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.884642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.884954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.885844 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.886167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.886486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.886797 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.887126 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.887449 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.887809 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.888138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.888615 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.889551 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.890128 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.890652 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.891172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.891717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.892261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.892631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.892975 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.893297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.893619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.893986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.894314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.894764 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.895266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.895817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.896280 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.896788 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.897303 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.897861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.898482 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.899052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.899603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.899957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.900244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.900535 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.900977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.901414 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.901738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.902093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.902601 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.902980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.903495 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.903995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.904505 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.905036 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.905635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.906254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.906771 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.907278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.907776 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.908326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.908871 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.909427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.912386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.912386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.912386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.912386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.913354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.913354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.913844 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.913844 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.914387 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.914895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.915376 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.915902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.916468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.917530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.918055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.918579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.919042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.919487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.919954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.920434 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.920950 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.921453 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.921813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.922144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.922497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.922811 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.923149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.923515 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.923853 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.924183 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.924513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.924836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.925154 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.925486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.925861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.926139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.926472 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.926813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.927136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.927453 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.927898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.928230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.928586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.928888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.929207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.929545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.929897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.930221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.930552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.930872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.931211 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.931597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.932607 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.932863 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.933124 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.933364 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.933657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.934001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.934329 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.934644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.934960 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.935273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.935683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.935963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.936287 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.936595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.936907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.937330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.937580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.937845 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.938186 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.938503 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.938837 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.939247 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.939486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.939922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.940159 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.940500 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.940718 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.940945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.941289 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.945459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.947646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.947646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.950424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.950424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.951032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.951032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.951502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.951502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.951960 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.953105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.953464 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.953817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.954858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.955179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.955780 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.956051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.956309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.956549 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.957003 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.957221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.957469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.958288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.958288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.958708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.958872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.959139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.959429 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.959811 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.960096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.960419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.960739 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.961081 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.961415 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.961776 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.962137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.962495 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.962832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.963534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.963534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.964342 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:47.964342 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:32:48.028092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO dbcounter [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Registered counter for database nova_api Aug 29 21:32:48.050664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_db.sqlalchemy.engines [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:48.060500 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writer thread running {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:48.149208 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:32:48.149934 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:32:48.149934 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:32:48.150271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:32:48.150525 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:32:48.151447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.151780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.152170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.152515 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.152735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.153043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.153359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.153680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.154048 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.154318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.154621 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.154943 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854267-3-iscsi {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.155257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.155399 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.context [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2(cell1) {{(pid=127069) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:32:48.155560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.155858 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.156171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.156473 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.156788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.157092 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.157598 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.157950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.158593 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.159131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.159739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.160165 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.160484 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.160862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.161174 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.161529 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.161874 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.162282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854267-3-iscsi {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.162603 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.162778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:48.162915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.163210 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.163522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:48.163689 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.163924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.164232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.164551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.164870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.165175 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.165517 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.165717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:48.165906 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.166160 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.167312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:48.167496 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.167646 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.167907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.168035 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:48.168222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.168538 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.168843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.169427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.169684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.170063 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.170384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.170519 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:48.170699 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.171024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.171272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.171522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.171841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.172161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.172626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.172944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.173088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO dbcounter [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Registered counter for database nova_cell0 Aug 29 21:32:48.173251 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.173560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.173882 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.174193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.174501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.174804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.175115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.175430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.175746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.176197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.176516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.176913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.177166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.177471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.177858 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.178160 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.178320 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO dbcounter [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Registered counter for database nova_cell1 Aug 29 21:32:48.178526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.179099 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.179674 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.180133 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.180694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.181103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.181682 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.182331 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.182908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.183387 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.183947 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.184522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.184992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.185413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.185894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.186145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.186588 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.186909 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.187234 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.187545 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.187861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.188178 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.188335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_db.sqlalchemy.engines [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:48.188496 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.188885 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.189668 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.190301 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.190912 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.191082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.191361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.191677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.193871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.193871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.193871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.193871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.193871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.194314 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.194314 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.194620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.195915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.195915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.195915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.195915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.196340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.196597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.196912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writer thread running {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:48.197021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.197222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.197677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.198420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.198533 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_db.sqlalchemy.engines [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:48.198617 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.198922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.199252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.199555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.199864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.200177 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.200501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.200884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.201126 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.201435 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.201750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.202095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:32:48.202439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.202772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.203114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.203428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.203758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.204089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.204407 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.204716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.205028 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.205352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.205841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.206158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.206467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.206788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.207110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.207589 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.207916 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.208231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.208551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.208856 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.209764 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.210129 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.210459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.210772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.211116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.211462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.211785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.212137 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.212462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.212774 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.213085 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.214823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.215085 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.215425 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.215745 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.216066 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.216383 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.216708 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.217023 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.217336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.217835 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.218006 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.218329 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.218634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.218920 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.219239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.219552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.219865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.220183 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.220497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.220803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.221276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.221589 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.221922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.222235 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.222539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.222850 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.223167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.223493 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.223800 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.224139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.224438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.224744 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.225053 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.225363 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.225662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.226004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.226306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.226615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.226936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.227239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.227543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.227868 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.228171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.228596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.230365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.230711 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.231037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.231394 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.231673 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.232005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.232323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.232641 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.232981 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.233313 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.233624 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.233976 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.234304 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.234620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.235097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.235411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.235854 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.236162 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.236469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.236781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.237086 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.237391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.237742 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.237997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.238306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.238782 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.239013 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.239232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.239515 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.239821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.240167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.240473 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.240815 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.241151 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.241469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.241839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.242225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.242776 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.243323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.243862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.244379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.245221 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.245695 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.246705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.246705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.246705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.247340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.247340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.247761 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.248074 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.248286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.248573 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.248958 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.249225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.249551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.249937 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.250211 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.250690 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.251006 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.251319 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.251633 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.251953 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.252389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.252715 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.253032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.253353 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.253670 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.254012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.254318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.254630 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.254965 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.255291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.255597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.255911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.256233 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.256546 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.256852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.257161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.257467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.257932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.258439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.259068 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.259448 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.260579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.260976 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.262361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.262361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.262806 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.263147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.263599 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.264059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.264499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.264954 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.265402 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.265971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.266600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.267237 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.267746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.268193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.268659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.269113 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.269629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.270151 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.270585 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.271106 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.271559 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.272000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.272444 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.272886 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.273322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.273820 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.274255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.274793 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.275338 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.276377 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.276979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.277353 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.277816 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.278260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.278699 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.279197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.279694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.280335 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.280680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.281438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.283354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.283354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.283354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.284014 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.284482 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.284994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.285473 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.286029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.286465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.286904 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.287336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.287785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.288256 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.288692 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.289132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.289582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.290121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.290629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.291283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.291914 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.292505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.292941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.293633 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.294128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.294569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.295049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.295488 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.295921 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.296366 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.296807 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.297285 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.297719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.298301 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.298754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.299229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.299662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.300272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.300780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.301215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.301723 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.302203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.302718 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.303160 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.303593 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.304048 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.304582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.305216 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.305684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.306174 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.306611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.307796 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.307796 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.308250 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.308684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.309178 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.309697 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.310211 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.310595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.311270 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.311707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.312136 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.312580 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.313072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.313513 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.316539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.316539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.316539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.316539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.316539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.317615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.317615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.318315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.318658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.319203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.319661 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.320184 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.320737 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.321244 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.321696 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.323980 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.324260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.324685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.325103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.325672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.326141 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.326644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.327059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.327505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.327962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.328402 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.328845 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.329284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.329729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.330379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.330878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.331423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.331919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.332447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.332905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.333411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.333872 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.334320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.334771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.335228 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.335672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.336120 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.336553 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.337012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.337471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.337975 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.338962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.339669 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.340202 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.340795 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.341159 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.341662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.342135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.342646 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.343085 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.343571 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.344036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.344491 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.344936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.345379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.345886 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.346326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.346831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.347269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.347709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.348163 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.348605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.349038 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.349486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.350034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.350577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.351077 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.351809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.353076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.354332 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.354749 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.354996 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.355421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.356021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.356420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.356946 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.357495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.357990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.358455 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.358924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.359382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.359843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.360303 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.360848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.361368 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.361929 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.362667 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.363228 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.364052 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.364356 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.364899 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.365359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.365960 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.366841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.367365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.367831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.368193 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writer thread running {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:48.368452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.368878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.369551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.370093 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.370620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.371644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.372107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.372522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.373001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.373548 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.374237 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.375247 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.375247 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.376105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.376645 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.377621 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.378378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.378779 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.379049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO dbcounter [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Registered counter for database nova_cell0 Aug 29 21:32:48.379388 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.379859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.380308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.380764 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.381310 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.382109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.382533 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.382991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.383456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.383888 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.384255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.384691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.385729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.386146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.386547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.386987 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.387413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.387557 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_db.sqlalchemy.engines [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:48.387857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.388275 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.388667 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.389040 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.389437 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.389839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.390226 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.390679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.391193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.391705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.392328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writer thread running {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:48.392604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.393000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.393489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.393998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.394763 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.395269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.395754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.396219 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.396685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.397171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.397647 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.398118 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.398587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.399039 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.399616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.400092 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.400605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.401684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.402240 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.402756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.403235 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.403685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.404159 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.404745 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.405268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.405740 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.406232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.406740 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.407255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.407765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.408422 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.408782 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.409665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.410366 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.410832 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.411363 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.411902 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.412439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.412967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.413423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.413938 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.414401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.414910 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.415683 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.416162 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.416650 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.417110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.417592 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.418247 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.418707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.419173 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.419630 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.420101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.420559 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.421035 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.421504 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.422070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.422632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.423158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.423617 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.424076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.424539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.425115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.425695 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.426348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.426813 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.427276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.427771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.428238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.428696 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.429302 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.430282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.430282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.430873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.431440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.432398 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.433312 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.433828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.434358 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.434895 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.442294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.443357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.443357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.443357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.443357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.443357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.444107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.444107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.444577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.445094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.445650 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.446220 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.446763 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.448308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.449127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.449693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.450317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.450899 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.451462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.452009 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.452597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.453117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.453663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.454659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.455301 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.455822 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.456316 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.456885 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.457443 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.458025 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.458784 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.459119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.459802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.460250 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.460790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.461350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.461936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.462495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.463018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.464376 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.464933 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.465539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.466080 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.466630 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.467133 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.467705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.468241 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.468901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.469347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.469971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.470783 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.471339 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.471901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.472471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.473062 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.473826 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.474420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.475123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.475756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.476679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.477307 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.477895 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.478513 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.480012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.481535 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.481535 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.481535 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.482153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.482710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.483267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.483821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.484398 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.484893 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.485413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.485991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.486530 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.487102 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.487647 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.488239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.488779 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.489874 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.490420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.493911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.493911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.493911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.493911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.493911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.493911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.497709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.497709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.497709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.497709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.497709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.498881 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.498881 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.499226 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.499914 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.500688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.501170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.501709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.502443 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.503015 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.503589 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.504162 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.504724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.505418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.505886 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.506568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.507128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.507665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.508212 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.508748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.509292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.509870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.513494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.513494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.513494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.513494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.513494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.513494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.514968 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.514968 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.514968 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.515528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.516069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.516620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.517182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.517723 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.518378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.518919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.519497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.520055 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.520615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.521368 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.521936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.522495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.523090 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.523687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.524249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.524842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.525402 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.526142 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.527082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.527324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.527876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.528453 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.529015 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.529627 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.530218 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.530790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.531579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.532309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.532861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.533410 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.534200 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.534766 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.535276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.535769 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.536352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.536908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.537501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.538086 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.538680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.539255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.539800 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.540323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.540852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.541917 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.542940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.543157 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.543550 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.544128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.544702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.545318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.545959 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.546519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.547098 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.547582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.548320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.548817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.549420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.550197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.550750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.551300 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.551833 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:32:48.552258 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:32:48.726254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: WARNING keystonemiddleware.auth_token [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:32:48.735564 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: WARNING keystonemiddleware.auth_token [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:32:48.797318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO dbcounter [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Registered counter for database nova_api Aug 29 21:32:48.826969 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_db.sqlalchemy.engines [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:48.835183 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writer thread running {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:48.922075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.context [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2(cell1) {{(pid=127068) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:32:48.926840 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:48.927343 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:48.929060 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:48.929910 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:32:48.930378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:32:48.933945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:32:48.936490 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO dbcounter [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Registered counter for database nova_cell0 Aug 29 21:32:48.941158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO dbcounter [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Registered counter for database nova_cell1 Aug 29 21:32:48.955922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_db.sqlalchemy.engines [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:48.962639 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_db.sqlalchemy.engines [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:48.966778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writer thread running {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:49.105481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: WARNING keystonemiddleware.auth_token [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:32:49.111709 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: WARNING keystonemiddleware.auth_token [None req-ad80c63a-0e10-47be-9d6a-3a36ecf2b252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:32:49.117137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55adb40c79c0 pid: 127069 (default app) Aug 29 21:32:49.170714 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writer thread running {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:49.181623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO dbcounter [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Registered counter for database nova_cell0 Aug 29 21:32:49.194082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_db.sqlalchemy.engines [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:32:49.204108 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writer thread running {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:32:49.593555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: WARNING keystonemiddleware.auth_token [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:32:49.606534 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: WARNING keystonemiddleware.auth_token [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:32:49.962687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: WARNING keystonemiddleware.auth_token [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:32:49.969441 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: WARNING keystonemiddleware.auth_token [None req-d527e815-7f36-4c49-a5e0-cab1b893e43f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:32:49.974887 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55adb40c79c0 pid: 127068 (default app) Aug 29 21:33:33.452969 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:33.459254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:33.470075 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:33.473628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:34.886558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-055c67ff-1c95-474f-9fb8-cb14fbe694a9 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Action: 'create', calling method: .version_select at 0x7f8be08f5ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1776982363"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:37.070093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-055c67ff-1c95-474f-9fb8-cb14fbe694a9 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.644425 Aug 29 21:33:37.072570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 1/1] 10.222.0.90 () {60 vars in 1155 bytes} [Mon Aug 29 21:33:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3650 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:33:37.115223 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b89b2684-4e33-4168-8e3a-cb372f245fbb tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be0778d30>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:37.374890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7e375d4c-ecfb-4567-99fa-dc82e47ad25f tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be098c940>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:37.408311 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b89b2684-4e33-4168-8e3a-cb372f245fbb tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f" status: 200 len: 345 microversion: 2.1 time: 0.315215 Aug 29 21:33:37.409246 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 2/2] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:37 2022] GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f => generated 345 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:37.472184 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:37.474059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:37.475705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:37.482043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:38.427627 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-15b55e50-5f72-45dd-bd0e-b0bf4c80c140 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be078f430>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:38.528684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7e375d4c-ecfb-4567-99fa-dc82e47ad25f tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3f6cc9fc-db5d-4ea4-854c-5814ea822aad" status: 200 len: 350 microversion: 2.1 time: 2.237560 Aug 29 21:33:38.530884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 1/3] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:36 2022] GET /compute/v2.1/os-volumes/3f6cc9fc-db5d-4ea4-854c-5814ea822aad => generated 350 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:38.810070 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-15b55e50-5f72-45dd-bd0e-b0bf4c80c140 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f" status: 200 len: 346 microversion: 2.1 time: 0.386391 Aug 29 21:33:38.810838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 3/4] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:38 2022] GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f => generated 346 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:38.829009 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e624aa8e-cf19-4660-982b-a5eeeb794957 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Action: 'create', calling method: .version_select at 0x7f8be0763c10>, body: {"snapshot": {"volume_id": "fa953c88-362a-4e68-a76d-25c0863d132f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-168787160"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:39.395178 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e624aa8e-cf19-4660-982b-a5eeeb794957 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.571298 Aug 29 21:33:39.396167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 2/5] 10.222.0.90 () {60 vars in 1162 bytes} [Mon Aug 29 21:33:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:39.411786 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-30200936-3ea6-428a-9bcf-a2defe239b17 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be078faf0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:39.529902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-30200936-3ea6-428a-9bcf-a2defe239b17 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 200 len: 286 microversion: 2.1 time: 0.124054 Aug 29 21:33:39.531671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 4/6] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 21:33:39 2022] GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:39.544036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3d9d33b9-8076-40e9-b403-fd3a76617617 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be07269d0>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:39.683261 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3d9d33b9-8076-40e9-b403-fd3a76617617 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.143849 Aug 29 21:33:39.695312 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 3/7] 10.222.0.90 () {58 vars in 1140 bytes} [Mon Aug 29 21:33:39 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:39.700286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9dd4e44b-62ac-4cd0-9cce-32efc9d13f8f tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be0778c10>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:39.960567 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9dd4e44b-62ac-4cd0-9cce-32efc9d13f8f tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 200 len: 286 microversion: 2.1 time: 0.265680 Aug 29 21:33:39.971119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 5/8] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 21:33:39 2022] GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 286 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:40.979346 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-076bd0b4-35d2-46de-be69-4fc5bbd41c94 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be0726b80>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:41.135645 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-076bd0b4-35d2-46de-be69-4fc5bbd41c94 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 200 len: 286 microversion: 2.1 time: 0.161490 Aug 29 21:33:41.141540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 4/9] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 21:33:40 2022] GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:42.154515 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6e0fba84-1d08-44d0-ae05-db5cbf812d0b tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be078f9d0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:42.326953 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6e0fba84-1d08-44d0-ae05-db5cbf812d0b tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 200 len: 286 microversion: 2.1 time: 0.181051 Aug 29 21:33:42.327513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 6/10] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 21:33:42 2022] GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:43.343982 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0fa91ec0-aaf9-4430-9dc1-c9ca6984a277 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be073d040>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:43.356597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2c75a08e-2427-4633-b546-4fc1a481bdd6 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be078f310>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:43.404397 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2c75a08e-2427-4633-b546-4fc1a481bdd6 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 200 len: 287 microversion: 2.1 time: 0.061932 Aug 29 21:33:43.405209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 7/11] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 21:33:43 2022] GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:43.421486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-37be4e4d-5136-4943-b9fe-dd6ba41ec9aa tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be078f280>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:43.479770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0fa91ec0-aaf9-4430-9dc1-c9ca6984a277 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/dcc6a841-e8bd-425a-9693-8be0f0832fb4" status: 200 len: 350 microversion: 2.1 time: 0.142190 Aug 29 21:33:43.480608 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 5/12] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:43 2022] GET /compute/v2.1/os-volumes/dcc6a841-e8bd-425a-9693-8be0f0832fb4 => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:43.535036 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-37be4e4d-5136-4943-b9fe-dd6ba41ec9aa tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "DELETE /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 202 len: 0 microversion: 2.1 time: 0.118057 Aug 29 21:33:43.536584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 8/13] 10.222.0.90 () {58 vars in 1254 bytes} [Mon Aug 29 21:33:43 2022] DELETE /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:33:43.551864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-67391417-e5c7-4eae-843c-afed11bc34fd tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be073d790>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:43.627410 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-67391417-e5c7-4eae-843c-afed11bc34fd tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 200 len: 286 microversion: 2.1 time: 0.084858 Aug 29 21:33:43.627941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 6/14] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 21:33:43 2022] GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:44.643197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8b10926c-0ddc-41ca-8d84-2acf30ba1f30 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be078f940>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:44.722575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-8b10926c-0ddc-41ca-8d84-2acf30ba1f30 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] HTTP exception thrown: Snapshot fd3e0ff3-6907-4ab0-91ed-7814fab29e40 could not be found. Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8b10926c-0ddc-41ca-8d84-2acf30ba1f30 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Request method failure captured: Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 HTTP/1.1 Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTCt852b1QjKqhguf0eOuvh_p8CyHOUkCQOmuVrPA7MXuwDF706kQWbq4q1Ep_183FlA5jI8rFT2jrZQEk8uTwyHFKnOqBQtFCulVcjmAIfADUDNzOHf6LAUBEfFgmmhSGr9N_G9ATNS_9xoppmhnzv-nDp3efaUQuIhSpFJ9HgbiIU Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:33:44.734390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3057e78899314a99bf88c55ab9b0fa25", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: c2f53bb29a90436782679aed93fa2c49 Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Snapshot fd3e0ff3-6907-4ab0-91ed-7814fab29e40 could not be found. Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': 'fd3e0ff3-6907-4ab0-91ed-7814fab29e40'} Aug 29 21:33:44.737393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fd3e0ff3-6907-4ab0-91ed-7814fab29e40 could not be found. (HTTP 404) (Request-ID: req-0dfa55c4-7d38-47ad-aa00-510676ca7e16) Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:33:44.739166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:33:44.741284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fd3e0ff3-6907-4ab0-91ed-7814fab29e40 could not be found. Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 21:33:44.743596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fd3e0ff3-6907-4ab0-91ed-7814fab29e40 could not be found. Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fd3e0ff3-6907-4ab0-91ed-7814fab29e40 could not be found. Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:33:44.747957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8b10926c-0ddc-41ca-8d84-2acf30ba1f30 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Returning 404 to user: Snapshot fd3e0ff3-6907-4ab0-91ed-7814fab29e40 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:44.760583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8b10926c-0ddc-41ca-8d84-2acf30ba1f30 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40" status: 404 len: 111 microversion: 2.1 time: 0.116909 Aug 29 21:33:44.762085 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 9/15] 10.222.0.90 () {58 vars in 1251 bytes} [Mon Aug 29 21:33:44 2022] GET /compute/v2.1/os-snapshots/fd3e0ff3-6907-4ab0-91ed-7814fab29e40 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:44.779030 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-02fd4c0e-dbb3-4d94-b611-52901f9c5324 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be0898d30>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:44.996627 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-02fd4c0e-dbb3-4d94-b611-52901f9c5324 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f" status: 202 len: 0 microversion: 2.1 time: 0.227706 Aug 29 21:33:44.998010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 7/16] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:33:44 2022] DELETE /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:33:45.017062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-efd84f49-3afa-4d16-8f72-639b29a6c15d tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be06f95e0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:45.177281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-efd84f49-3afa-4d16-8f72-639b29a6c15d tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f" status: 200 len: 345 microversion: 2.1 time: 0.172841 Aug 29 21:33:45.178241 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 10/17] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:45 2022] GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:45.307502 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c25bd467-ddf3-4f74-8de8-e12d0b0b6c5a tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be073db80>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:45.396273 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c25bd467-ddf3-4f74-8de8-e12d0b0b6c5a tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/406b0ff1-d9e2-4bf9-9f13-734b67c9fe7e" status: 200 len: 350 microversion: 2.1 time: 0.093034 Aug 29 21:33:45.397033 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 8/18] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:45 2022] GET /compute/v2.1/os-volumes/406b0ff1-d9e2-4bf9-9f13-734b67c9fe7e => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:45.433034 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-db06e537-bd24-432f-b6dd-c56083ae7422 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be06f9c10>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:45.630586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-db06e537-bd24-432f-b6dd-c56083ae7422 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.222628 Aug 29 21:33:45.631152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 11/19] 10.222.0.90 () {58 vars in 1134 bytes} [Mon Aug 29 21:33:45 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:45.653193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-15de4e0e-f83a-40e3-bad6-6c448a0a2e5f tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be073d4c0>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.041890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-15de4e0e-f83a-40e3-bad6-6c448a0a2e5f tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.396288 Aug 29 21:33:46.042823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 9/20] 10.222.0.90 () {58 vars in 1149 bytes} [Mon Aug 29 21:33:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:46.060658 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e0e95412-9c1d-43f2-96df-54215652b997 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be06f9af0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.207207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-80b82f04-ea0c-44c3-bf21-a8579294f082 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be073d040>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.313925 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-80b82f04-ea0c-44c3-bf21-a8579294f082 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] HTTP exception thrown: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.327756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e0e95412-9c1d-43f2-96df-54215652b997 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.266457 Aug 29 21:33:46.329295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 12/21] 10.222.0.90 () {58 vars in 1134 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-80b82f04-ea0c-44c3-bf21-a8579294f082 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Request method failure captured: Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f HTTP/1.1 Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTCt852b1QjKqhguf0eOuvh_p8CyHOUkCQOmuVrPA7MXuwDF706kQWbq4q1Ep_183FlA5jI8rFT2jrZQEk8uTwyHFKnOqBQtFCulVcjmAIfADUDNzOHf6LAUBEfFgmmhSGr9N_G9ATNS_9xoppmhnzv-nDp3efaUQuIhSpFJ9HgbiIU Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:33:46.337498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3057e78899314a99bf88c55ab9b0fa25", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: c2f53bb29a90436782679aed93fa2c49 Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'fa953c88-362a-4e68-a76d-25c0863d132f'} Aug 29 21:33:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. (HTTP 404) (Request-ID: req-de75bbfa-74c3-43ce-8e3b-71090695b888) Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.341318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:33:46.345817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:33:46.349810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.355509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.357687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-95643db9-c118-4372-bfd0-f87dfd343d14 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be06fc5e0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.360050 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-80b82f04-ea0c-44c3-bf21-a8579294f082 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Returning 404 to user: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:46.362085 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-80b82f04-ea0c-44c3-bf21-a8579294f082 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f" status: 404 len: 109 microversion: 2.1 time: 0.166734 Aug 29 21:33:46.365702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 10/22] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:46.400034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-03cf4600-5ef2-4068-92c7-746fd7e2c80b tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be073d430>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.584795 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-03cf4600-5ef2-4068-92c7-746fd7e2c80b tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] HTTP exception thrown: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-03cf4600-5ef2-4068-92c7-746fd7e2c80b tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Request method failure captured: Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: DELETE /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f HTTP/1.1 Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTCt852b1QjKqhguf0eOuvh_p8CyHOUkCQOmuVrPA7MXuwDF706kQWbq4q1Ep_183FlA5jI8rFT2jrZQEk8uTwyHFKnOqBQtFCulVcjmAIfADUDNzOHf6LAUBEfFgmmhSGr9N_G9ATNS_9xoppmhnzv-nDp3efaUQuIhSpFJ9HgbiIU Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:33:46.587659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3057e78899314a99bf88c55ab9b0fa25", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: c2f53bb29a90436782679aed93fa2c49 Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'fa953c88-362a-4e68-a76d-25c0863d132f'} Aug 29 21:33:46.591472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. (HTTP 404) (Request-ID: req-00f006fe-05f3-4c09-b934-e04eb690a698) Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.592741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:33:46.594615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:33:46.596409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-03cf4600-5ef2-4068-92c7-746fd7e2c80b tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Returning 404 to user: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-03cf4600-5ef2-4068-92c7-746fd7e2c80b tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f" status: 404 len: 109 microversion: 2.1 time: 0.206887 Aug 29 21:33:46.604236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 11/23] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:33:46 2022] DELETE /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:46.607794 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-40d20e2c-4cf1-4315-8645-7eccc30dce99 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Calling method '.version_select at 0x7f8be069d8b0>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.693312 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-40d20e2c-4cf1-4315-8645-7eccc30dce99 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] HTTP exception thrown: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-40d20e2c-4cf1-4315-8645-7eccc30dce99 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Request method failure captured: Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f HTTP/1.1 Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTCt852b1QjKqhguf0eOuvh_p8CyHOUkCQOmuVrPA7MXuwDF706kQWbq4q1Ep_183FlA5jI8rFT2jrZQEk8uTwyHFKnOqBQtFCulVcjmAIfADUDNzOHf6LAUBEfFgmmhSGr9N_G9ATNS_9xoppmhnzv-nDp3efaUQuIhSpFJ9HgbiIU Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:33:46.697601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/3057e78899314a99bf88c55ab9b0fa25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_3057e78899314a99bf88c55ab9b0fa25", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 3057e78899314a99bf88c55ab9b0fa25 Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1604055154 Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: c2f53bb29a90436782679aed93fa2c49 Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1604055154-project Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'fa953c88-362a-4e68-a76d-25c0863d132f'} Aug 29 21:33:46.698760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. (HTTP 404) (Request-ID: req-9656e54e-7101-46d3-a5f3-45cc69b331c5) Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.699994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:33:46.701907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:33:46.704308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:33:46.710451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-40d20e2c-4cf1-4315-8645-7eccc30dce99 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] Returning 404 to user: Volume fa953c88-362a-4e68-a76d-25c0863d132f could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:33:46.712264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-95643db9-c118-4372-bfd0-f87dfd343d14 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.367708 Aug 29 21:33:46.713941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-40d20e2c-4cf1-4315-8645-7eccc30dce99 tempest-VolumesSnapshotsTestJSON-1604055154 tempest-VolumesSnapshotsTestJSON-1604055154-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f" status: 404 len: 109 microversion: 2.1 time: 0.110621 Aug 29 21:33:46.715006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 13/24] 10.222.0.90 () {58 vars in 1167 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:46.715477 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 12/25] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/os-volumes/fa953c88-362a-4e68-a76d-25c0863d132f => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:33:46.750325 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f70d9b14-5545-4f4a-9be2-a3a50ec5a43a tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be06fc3a0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:46.929158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f70d9b14-5545-4f4a-9be2-a3a50ec5a43a tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.191286 Aug 29 21:33:46.932087 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 14/26] 10.222.0.90 () {58 vars in 1170 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:46.957273 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-760b6cec-5463-45bc-bdde-8ca9d5a29d86 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be073d160>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:47.253122 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-760b6cec-5463-45bc-bdde-8ca9d5a29d86 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.302716 Aug 29 21:33:47.256054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 13/27] 10.222.0.90 () {58 vars in 1155 bytes} [Mon Aug 29 21:33:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:47.280807 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6d2dd298-b919-4a4d-a7c0-f2629419f412 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be069d3a0>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:47.658446 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6d2dd298-b919-4a4d-a7c0-f2629419f412 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.382961 Aug 29 21:33:47.659657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 14/28] 10.222.0.90 () {58 vars in 1188 bytes} [Mon Aug 29 21:33:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:33:47.676244 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-98520721-fe0b-424b-88e3-29728d6c8fe1 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] Calling method '.version_select at 0x7f8be06b5f70>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:47.770329 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-151531071", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:48.103952 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-98520721-fe0b-424b-88e3-29728d6c8fe1 tempest-VolumesTestJSON-2082605791 tempest-VolumesTestJSON-2082605791-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.434560 Aug 29 21:33:48.104713 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 15/29] 10.222.0.90 () {58 vars in 1155 bytes} [Mon Aug 29 21:33:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:33:48.172546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] validate_networks() for [('60f0f1c2-7dff-4e25-9e4a-77c8e5d3f3e2', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:33:49.923911 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:33:49.928399 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:33:49.930657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:33:49.932158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:33:49.933214 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:33:49.978987 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:49.979402 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:49.979914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:49.980818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:49.987834 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:49.988514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:50.115555 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for project fb0643eb366140d59f96d86259557915. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:33:50.140717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for user 39f161e61a514d94b6008bd006cda5ce and project fb0643eb366140d59f96d86259557915. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:33:50.194912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:33:50.213817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:33:50.444235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8a9c7ee7-d057-45a2-9f26-fc436cff23fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.415041 Aug 29 21:33:50.444892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 15/30] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:33:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 3417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:33:50.461982 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4a9125e3-a98f-4ecb-b0d5-604f6410316c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:50.462837 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4a9125e3-a98f-4ecb-b0d5-604f6410316c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:50.852651 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4a9125e3-a98f-4ecb-b0d5-604f6410316c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:50.895152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4a9125e3-a98f-4ecb-b0d5-604f6410316c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1221 microversion: 2.1 time: 0.437649 Aug 29 21:33:50.901348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 16/31] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:50 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1221 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:51.334773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1785030149", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:51.522589 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] validate_networks() for [('60f0f1c2-7dff-4e25-9e4a-77c8e5d3f3e2', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:33:53.686799 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:33:53.687441 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:33:53.689248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:33:53.689833 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:33:53.690869 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:33:53.735621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:53.739749 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:53.750939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:53.752061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:53.752714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:53.753315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:53.793622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for project fb0643eb366140d59f96d86259557915. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:33:53.799039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for user 39f161e61a514d94b6008bd006cda5ce and project fb0643eb366140d59f96d86259557915. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:33:53.828673 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:33:53.839602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:33:53.946564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b458a6fc-b834-4b03-abf6-d40dfc570542 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'create', calling method: .version_select at 0x7f8be06b53a0>, body: {"keypair": {"name": "tempest-keypair-757271228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHJx4EYTu9jp0RlHwIw8KP/9XYUQcOkhs3u/BzreqxjU/FL07Iz1m0knxW7j7nmNZbdi9cfVirFi/4SGODSwAW5F1fqoLpynA2acDGTbeZYSzGT32260ZyVuu1gijrgBw=="}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:53.998065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-56c728dc-a197-45c1-8795-812bba99b21f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.668632 Aug 29 21:33:53.999184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 16/32] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:33:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:33:54.031187 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9c6522d9-148f-4218-893b-09e179219b53 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:54.032444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9c6522d9-148f-4218-893b-09e179219b53 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:54.228971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-b458a6fc-b834-4b03-abf6-d40dfc570542 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for project a2847581073e482d8ec3090bcafe93a7. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:33:54.255744 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-b458a6fc-b834-4b03-abf6-d40dfc570542 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for user b33a740f1c8a4d9db8d199eff66b76b2 and project a2847581073e482d8ec3090bcafe93a7. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:33:54.415069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b458a6fc-b834-4b03-abf6-d40dfc570542 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.881685 Aug 29 21:33:54.417129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9c6522d9-148f-4218-893b-09e179219b53 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:54.425828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 17/33] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:33:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:54.488007 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9c6522d9-148f-4218-893b-09e179219b53 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1222 microversion: 2.1 time: 0.481415 Aug 29 21:33:54.489988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 17/34] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:54 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1222 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:55.512121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-570729cb-1a52-43db-8f7c-0afb68d644d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:55.512867 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-570729cb-1a52-43db-8f7c-0afb68d644d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:55.863484 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-570729cb-1a52-43db-8f7c-0afb68d644d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:55.873807 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-570729cb-1a52-43db-8f7c-0afb68d644d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1222 microversion: 2.1 time: 0.366812 Aug 29 21:33:55.908639 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 18/35] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:55 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1222 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:33:56.915278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:56.915987 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:56.941097 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.941966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.942565 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:56.947306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:56.953113 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:56.953885 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:57.965029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:57.970190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d11184ec-f202-4bad-b48e-f206b9b94fbf tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Action: 'create', calling method: .version_select at 0x7f8be05d6670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-501205424", "metadata": {"Type": "work"}}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:33:57.992140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-755f9e5f-e7ca-4403-8f9c-2da78c6fe483 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1274 microversion: 2.1 time: 1.080749 Aug 29 21:33:58.005018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 18/36] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:56 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1274 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:33:59.026948 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:59.027643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:33:59.059611 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:59.060346 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:59.060816 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:59.061769 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:33:59.074654 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:33:59.075138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:33:59.117716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d11184ec-f202-4bad-b48e-f206b9b94fbf tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.999542 Aug 29 21:33:59.118701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 19/37] 10.222.0.90 () {60 vars in 1156 bytes} [Mon Aug 29 21:33:57 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2003 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:33:59.134827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6abf789e-f135-4777-8e55-6dece260f136 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Calling method '.version_select at 0x7f8be05faa60>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:33:59.359425 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6abf789e-f135-4777-8e55-6dece260f136 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e" status: 200 len: 352 microversion: 2.1 time: 0.230488 Aug 29 21:33:59.361601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 20/38] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:33:59 2022] GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e => generated 352 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:33:59.910187 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:33:59.923556 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-06f0de8f-513b-4360-b34d-86adc3b761cb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1280 microversion: 2.1 time: 0.902697 Aug 29 21:33:59.946427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 19/39] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:33:59 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1280 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:00.036962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-13397194", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "networks": [{"uuid": "c4d19751-37c9-4e07-97aa-74d0b6d468c3"}]}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:00.289363 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] validate_networks() for [('c4d19751-37c9-4e07-97aa-74d0b6d468c3', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:00.383334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-72f29df4-79a7-45d4-b32d-37396b361a49 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Calling method '.version_select at 0x7f8bdfce1b80>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:00.604966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-72f29df4-79a7-45d4-b32d-37396b361a49 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e" status: 200 len: 353 microversion: 2.1 time: 0.228822 Aug 29 21:34:00.606296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 20/40] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:00 2022] GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e => generated 353 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:00.621354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1b6d8822-403e-45cf-83e2-c7d5ec645c81 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Calling method '.version_select at 0x7f8bdfd38dc0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:00.904128 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1b6d8822-403e-45cf-83e2-c7d5ec645c81 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e" status: 200 len: 353 microversion: 2.1 time: 0.288448 Aug 29 21:34:00.904773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 21/41] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:00 2022] GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e => generated 353 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:00.931958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-99c3ee2d-cc90-4a75-b15e-594d09c08916 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Calling method '.version_select at 0x7f8bdfd41430>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:01.804957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-99c3ee2d-cc90-4a75-b15e-594d09c08916 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e" status: 202 len: 0 microversion: 2.1 time: 0.883462 Aug 29 21:34:01.806604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 22/42] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:34:00 2022] DELETE /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e => generated 0 bytes in 886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:34:01.826212 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:01.827719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:01.887903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:01.888410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:01.888910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:01.889629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:01.920943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:01.925567 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:02.229439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:02.279589 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2d5f63d0-cb41-4f24-b95c-4fdf3c31e5a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1280 microversion: 2.1 time: 0.466974 Aug 29 21:34:02.306020 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 23/43] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:01 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1280 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:02.325706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4343947d-c1df-41f8-9a44-f3cdec1a5fd8 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Calling method '.version_select at 0x7f8bdfce1af0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:02.810131 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-4343947d-c1df-41f8-9a44-f3cdec1a5fd8 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] HTTP exception thrown: Volume 05d3d6ad-fbc6-477a-bf3b-22770dccdb2e could not be found. Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4343947d-c1df-41f8-9a44-f3cdec1a5fd8 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Request method failure captured: Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e HTTP/1.1 Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDEE2WIwtkGLoYSnQZCj0IZDbm6F5scpohmws3YrKjK_0eS692WuDhnqxyVQV5pQDfXrQmopXe6rpKdn67XfpTdXB3wYZeDxAU6LbbUKVVb-vQmPQs0aqtodMQlAJisxE_LzVYYm3UfkWHBBMhomlG3UkxvutZkkJvHsm6tGOzHq1o Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 4ce47d12b3aa4d618ae4880856c5093f Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-VolumesGetTestJSON-1850404477 Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:34:02.814419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4ce47d12b3aa4d618ae4880856c5093f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4ce47d12b3aa4d618ae4880856c5093f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4ce47d12b3aa4d618ae4880856c5093f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4ce47d12b3aa4d618ae4880856c5093f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-VolumesGetTestJSON-1850404477 Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 4ce47d12b3aa4d618ae4880856c5093f Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-VolumesGetTestJSON-1850404477 Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-VolumesGetTestJSON-1850404477-project Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 71b71ed8570941f9946baad3cc7e7fba Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-VolumesGetTestJSON-1850404477-project Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Volume 05d3d6ad-fbc6-477a-bf3b-22770dccdb2e could not be found. Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '05d3d6ad-fbc6-477a-bf3b-22770dccdb2e'} Aug 29 21:34:02.815618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05d3d6ad-fbc6-477a-bf3b-22770dccdb2e could not be found. (HTTP 404) (Request-ID: req-9afcf4c4-8d0c-4ac5-8ba7-7539a33caca6) Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:02.816352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:34:02.817700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05d3d6ad-fbc6-477a-bf3b-22770dccdb2e could not be found. Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:34:02.820135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05d3d6ad-fbc6-477a-bf3b-22770dccdb2e could not be found. Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05d3d6ad-fbc6-477a-bf3b-22770dccdb2e could not be found. Aug 29 21:34:02.821895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:02.825835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4343947d-c1df-41f8-9a44-f3cdec1a5fd8 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] Returning 404 to user: Volume 05d3d6ad-fbc6-477a-bf3b-22770dccdb2e could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:02.825835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4343947d-c1df-41f8-9a44-f3cdec1a5fd8 tempest-VolumesGetTestJSON-1850404477 tempest-VolumesGetTestJSON-1850404477-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e" status: 404 len: 109 microversion: 2.1 time: 0.517193 Aug 29 21:34:02.830067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 24/44] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:34:02 2022] GET /compute/v2.1/os-volumes/05d3d6ad-fbc6-477a-bf3b-22770dccdb2e => generated 109 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:03.329414 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:03.330622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:03.345518 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:03.347298 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:03.351470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:03.355983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:03.357273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:03.361009 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:03.770094 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=4 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:03.822752 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:03.844611 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d95d81e1-fbcc-416a-8148-a3230e75a56d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1280 microversion: 2.1 time: 0.521503 Aug 29 21:34:03.852532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 25/45] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:03 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1280 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:04.899498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:04.901106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:04.903433 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=14 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:04.933491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:04.946300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:04.957147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:04.958865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:04.961191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:04.972520 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:05.416074 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:05.439430 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e60d4606-27cf-4b18-a1de-54e4f5fade22 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1280 microversion: 2.1 time: 0.544642 Aug 29 21:34:05.449620 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 26/46] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:04 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1280 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:05.869867 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=8 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:06.478978 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:06.480381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:06.499798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.500410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.500933 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:06.501867 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:06.519538 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:06.519538 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:07.464835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:07.474075 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1592bef0-bf72-4f2e-8047-115e4e7c61ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1280 microversion: 2.1 time: 1.002612 Aug 29 21:34:07.487817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 27/47] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:06 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1280 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:07.994445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:07.995127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:07.995766 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:07.996368 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:07.996956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:08.054860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:08.062967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:08.078440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:08.083341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:08.087894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:08.096472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:08.359603 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Getting quotas for project 71f4912b8f1b4a5199fe6d11315c2658. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:08.395613 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Getting quotas for user 96d3a0e28dc247b5a7ee9434a4d6554c and project 71f4912b8f1b4a5199fe6d11315c2658. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:08.467071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:08.473643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:08.519995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:08.522702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:08.609266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:08.611292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:08.625920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:08.636620 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:08.640416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:08.644644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:08.812123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ec488805-4668-4cfb-9123-42c26e352017 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.437739 Aug 29 21:34:08.817059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 21/48] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:33:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 9455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:08.848836 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-39e85a8c-24b5-4059-b669-b961c30c100e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:08.849469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-39e85a8c-24b5-4059-b669-b961c30c100e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:09.908374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-39e85a8c-24b5-4059-b669-b961c30c100e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:09.950083 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-39e85a8c-24b5-4059-b669-b961c30c100e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1213 microversion: 2.1 time: 1.121330 Aug 29 21:34:09.953644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 22/49] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:08 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1213 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:10.483425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:10.523002 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0e7e3dbe-f6c9-4933-a6b5-b0363ccb1400 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 2.010257 Aug 29 21:34:10.526168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 28/50] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:08 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:11.008395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:11.009710 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:11.087118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:11.088255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:11.097470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:11.098902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:11.099871 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:11.100612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:11.259685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-32a577d9-cf3d-4dd6-8ef8-8367d7c98f21 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: .version_select at 0x7f8be055f040>, body: {"keypair": {"name": "tempest-keypair-1611206824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgwHS5n3g0qhgvu9NQNeAN1gi+zf0lnoTVexOlP9lFlT0j4NhtHDY/9qn/sNyR6iCBzliJLNRDp1ZMrygRFQVFQjEK53yuB29YI8sHpTQ2jhjLUTsT0rqaXbc3UF+Dsdw=="}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:11.418012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-32a577d9-cf3d-4dd6-8ef8-8367d7c98f21 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:11.433731 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-32a577d9-cf3d-4dd6-8ef8-8367d7c98f21 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:11.503332 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-32a577d9-cf3d-4dd6-8ef8-8367d7c98f21 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.545841 Aug 29 21:34:11.507984 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 23/51] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:34:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:11.550754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:11.551809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:11.565156 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:11.570859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:11.571827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:11.572947 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:11.573724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:11.574641 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:12.347297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:12.384485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0675bf7d-3676-4b76-a518-0f4e54abad59 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1217 microversion: 2.1 time: 1.364818 Aug 29 21:34:12.411162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 29/52] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:10 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1217 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:13.428590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:13.430331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:13.468863 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:13.469531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:13.476160 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:13.481395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:13.482190 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:13.491440 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:13.616526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=53 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:14.010894 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:14.044087 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8974ecb0-8f49-4bd7-893a-595f47d4fa1d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1273 microversion: 2.1 time: 0.620085 Aug 29 21:34:14.061906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 30/53] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:13 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1273 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:14.075743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-645968093", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36675b61-9044-4993-89f1-4d4f8e489fe9"}], "security_groups": [{"name": "tempest-securitygroup--1124426734"}], "key_name": "tempest-keypair-757271228", "user_data": "}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:15.835131 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] validate_networks() for [('36675b61-9044-4993-89f1-4d4f8e489fe9', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:16.368861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:16.438138 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9eddd5d7-0a3d-428b-bb63-25b4b29eb6db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 4.892299 Aug 29 21:34:16.444537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 24/54] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:11 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 4900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:16.593439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-df36af09-6495-41e6-af73-05c99535cf99 req-7646e8d9-3d6c-4f4a-bc67-fca49a4a4a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71714c3b-cd6f-413e-a16b-e97161abd750", "tag": "bcd222e7-b8b9-4f26-ba2d-337995705322"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:16.614240 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-df36af09-6495-41e6-af73-05c99535cf99 req-7646e8d9-3d6c-4f4a-bc67-fca49a4a4a80 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:16.615115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-df36af09-6495-41e6-af73-05c99535cf99 req-7646e8d9-3d6c-4f4a-bc67-fca49a4a4a80 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:16.616570 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-df36af09-6495-41e6-af73-05c99535cf99 req-7646e8d9-3d6c-4f4a-bc67-fca49a4a4a80 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:16.651418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-df36af09-6495-41e6-af73-05c99535cf99 req-7646e8d9-3d6c-4f4a-bc67-fca49a4a4a80 service nova] Creating event network-changed:bcd222e7-b8b9-4f26-ba2d-337995705322 for instance 71714c3b-cd6f-413e-a16b-e97161abd750 on hv-cinder-85426 Aug 29 21:34:16.657612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-df36af09-6495-41e6-af73-05c99535cf99 req-7646e8d9-3d6c-4f4a-bc67-fca49a4a4a80 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:34:16.663958 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-df36af09-6495-41e6-af73-05c99535cf99 req-7646e8d9-3d6c-4f4a-bc67-fca49a4a4a80 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:34:16.670111 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:16.671855 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:16.674591 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:16.682717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:16.683849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:16.684837 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:16.714019 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.compute.rpcapi [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:34:16.718079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] Releasing lock "compute-rpcapi-router" {{(pid=127068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:34:16.770735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-56e0539f-17fc-436d-bf88-2a1a17034a41 None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323181 Aug 29 21:34:16.778011 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 25/55] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:16.786893 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:16.788760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:16.799368 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:16.800413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:16.801178 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:16.802329 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:16.803328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:16.804147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:17.116894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:17.150588 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4280e885-817d-4098-8951-f1f3e9432a7d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1271 microversion: 2.1 time: 0.364523 Aug 29 21:34:17.152864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 26/56] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:16 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1271 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:17.487099 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:17.488713 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:17.508280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:17.515233 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:17.516803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:17.516980 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:17.518238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:17.523641 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:17.618062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:19.291741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:19.322677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f2d74e1d-104e-4717-97ef-ebd8f4c890b8 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 1.835009 Aug 29 21:34:19.352192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 27/57] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:17 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:19.369667 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:19.370693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:19.388461 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:19.394634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:19.396342 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:19.398720 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:19.399576 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:19.404784 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:19.407615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:19.726364 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:19.727367 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:19.728153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:19.728997 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:19.729755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:19.771124 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:19.772266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:19.772721 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:19.773486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:19.773989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:19.781943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:19.844145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for project a2847581073e482d8ec3090bcafe93a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:19.862989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for user b33a740f1c8a4d9db8d199eff66b76b2 and project a2847581073e482d8ec3090bcafe93a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:19.893148 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:19.895573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:20.024462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-039ece66-b951-4b92-9800-08f9aeb881a1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.971622 Aug 29 21:34:20.031863 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 31/58] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:34:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 5981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:20.449943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-4416e6e3-1019-4927-a388-af7200c90c0f req-af2387a2-0f1a-47fb-a0a5-c790bf796caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e39fe9-0de6-4578-b311-5a3a0b68b4bb", "tag": "1f9fa908-44cc-46c6-859f-62b67ba01880"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:20.529480 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4416e6e3-1019-4927-a388-af7200c90c0f req-af2387a2-0f1a-47fb-a0a5-c790bf796caf service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:20.536254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4416e6e3-1019-4927-a388-af7200c90c0f req-af2387a2-0f1a-47fb-a0a5-c790bf796caf service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:20.538267 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4416e6e3-1019-4927-a388-af7200c90c0f req-af2387a2-0f1a-47fb-a0a5-c790bf796caf service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:20.558878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:20.571779 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f61e4683-1b7e-4a9a-9871-5c728e157562 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 1.218694 Aug 29 21:34:20.572582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 28/59] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:19 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:20.592954 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-efb76a7e-f70e-4186-b7e9-61f8c795bae6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:20.593647 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-efb76a7e-f70e-4186-b7e9-61f8c795bae6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:20.635311 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-4416e6e3-1019-4927-a388-af7200c90c0f req-af2387a2-0f1a-47fb-a0a5-c790bf796caf service nova] Creating event network-changed:1f9fa908-44cc-46c6-859f-62b67ba01880 for instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb on hv-cinder-85426 Aug 29 21:34:20.636737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4416e6e3-1019-4927-a388-af7200c90c0f req-af2387a2-0f1a-47fb-a0a5-c790bf796caf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:34:20.637771 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4416e6e3-1019-4927-a388-af7200c90c0f req-af2387a2-0f1a-47fb-a0a5-c790bf796caf service nova] Acquired lock "compute-rpcapi-router" {{(pid=127069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:34:20.640258 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:20.645140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:20.645761 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:20.652701 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:20.653603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:20.654364 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:20.685574 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.compute.rpcapi [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:34:20.687224 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] Releasing lock "compute-rpcapi-router" {{(pid=127069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:34:20.732032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ef24276c-842a-4126-9a65-628f03f55f62 None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.698220 Aug 29 21:34:20.733707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 32/60] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:20.755301 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:20.756704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:20.782872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:20.795687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:20.798395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:20.801234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:20.808308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:20.809459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:21.051081 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-efb76a7e-f70e-4186-b7e9-61f8c795bae6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:21.077003 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-efb76a7e-f70e-4186-b7e9-61f8c795bae6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1236 microversion: 2.1 time: 0.503021 Aug 29 21:34:21.080399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 29/61] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:20 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1236 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:21.319932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:21.338636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ee312168-1601-4a93-9328-4c35abed9da5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 0.602376 Aug 29 21:34:21.340786 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 33/62] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:20 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:21.603477 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:21.604547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:21.631231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:21.634235 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:21.637223 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:21.643533 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:21.644387 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:21.645366 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.129029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:22.145853 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:22.162813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.167921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.169353 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.173286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.174397 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.175626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.596242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:22.634185 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-53c708a9-55f5-4727-88d4-5ca4108eff09 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1240 microversion: 2.1 time: 0.520597 Aug 29 21:34:22.635630 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 34/63] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:22 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1240 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:22.669097 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:22.670763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:22.729900 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.731117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.732018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:22.733148 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:22.733778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:22.734481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:23.044118 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:23.054724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-49b2712d-eac2-44c3-a2f9-ffb46d594778 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 1.461981 Aug 29 21:34:23.055569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 30/64] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:21 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:23.061646 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-db63b5f9-6d27-4cc1-9738-5c2a6ef0cd51 req-c25f795c-d6dc-405f-bc3c-8bab7f9482a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad", "tag": "41fa18fd-119a-4c3b-adab-d7a7816c2f11"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:23.076877 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-db63b5f9-6d27-4cc1-9738-5c2a6ef0cd51 req-c25f795c-d6dc-405f-bc3c-8bab7f9482a4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:23.077555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-db63b5f9-6d27-4cc1-9738-5c2a6ef0cd51 req-c25f795c-d6dc-405f-bc3c-8bab7f9482a4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:23.078802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-db63b5f9-6d27-4cc1-9738-5c2a6ef0cd51 req-c25f795c-d6dc-405f-bc3c-8bab7f9482a4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:23.095189 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-db63b5f9-6d27-4cc1-9738-5c2a6ef0cd51 req-c25f795c-d6dc-405f-bc3c-8bab7f9482a4 service nova] Creating event network-changed:41fa18fd-119a-4c3b-adab-d7a7816c2f11 for instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad on hv-cinder-85426 Aug 29 21:34:23.101018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-db63b5f9-6d27-4cc1-9738-5c2a6ef0cd51 req-c25f795c-d6dc-405f-bc3c-8bab7f9482a4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044060 Aug 29 21:34:23.102363 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 31/65] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:23.489215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:23.512178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-83005aa0-5ec7-4523-b67b-28a835e2aee0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 0.861010 Aug 29 21:34:23.534920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 35/66] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:22 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:23.661582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:23.662942 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:23.687265 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:23.698749 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:23.704157 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:23.705305 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:23.706032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:23.706802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:23.864020 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:23.873759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-83f8abcc-641f-4993-95fb-d8675fa018eb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1294 microversion: 2.1 time: 0.216390 Aug 29 21:34:23.885725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 32/67] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:23 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:24.029409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1946985346", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "377bc5c8-c6c6-472a-a33a-20e9d1f177b1"}], "security_groups": [{"name": "tempest-securitygroup--1208037778"}], "key_name": "tempest-keypair-1611206824", "user_data": "}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:24.100008 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:24.100830 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:24.121639 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:24.130064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:24.132267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:24.133208 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:24.135405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:24.135983 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:24.319312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] validate_networks() for [('377bc5c8-c6c6-472a-a33a-20e9d1f177b1', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:34:24.834425 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:24.872046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-affff33f-9598-4f9f-b839-9d846a90c54e tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 0.776412 Aug 29 21:34:24.876934 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 33/68] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:24 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:24.885747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:24.889275 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:24.913516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:24.914440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:24.915102 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:24.916084 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:24.916758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:24.917435 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:25.329459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:25.339879 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8ff5e9e1-aa35-4fa1-93f5-1802ce40c729 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 0.461517 Aug 29 21:34:25.341090 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 34/69] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:24 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:25.346469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:25.347268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:25.354825 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:25.355490 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:25.356143 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:25.357068 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:25.357676 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:25.358460 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:25.584436 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:34:25.585064 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:34:25.585462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:34:25.585906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:34:25.586331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:34:25.608637 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:25.609125 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:25.609569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:25.610358 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:25.611095 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:25.611530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:25.670950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:25.682010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-457aa1c6-43da-467d-9bf0-608591f6ba81 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1294 microversion: 2.1 time: 0.338923 Aug 29 21:34:25.693926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 35/70] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:25 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1294 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:25.694585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:34:25.697916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:34:25.722489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:34:25.727133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:34:25.827174 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7c38f8b0-6377-41f6-895b-2384f107c35c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.809610 Aug 29 21:34:25.828869 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 36/71] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:34:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:34:25.854285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4026aa96-ea5c-42bf-98de-859ad6af9774 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:25.855696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4026aa96-ea5c-42bf-98de-859ad6af9774 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:25.966546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-4026aa96-ea5c-42bf-98de-859ad6af9774 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:25.986314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4026aa96-ea5c-42bf-98de-859ad6af9774 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1242 microversion: 2.1 time: 0.146499 Aug 29 21:34:25.987653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 37/72] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:25 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:26.001943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:26.007931 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:26.018839 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:26.019755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:26.020824 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:26.022786 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:26.024058 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:26.025348 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:26.092394 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-867f37e2-01eb-48c6-aca3-6f016ed2ae07 req-14a7eab8-65d4-471b-a416-4a2571924d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71714c3b-cd6f-413e-a16b-e97161abd750", "name": "network-vif-plugged", "status": "completed", "tag": "bcd222e7-b8b9-4f26-ba2d-337995705322"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:26.156671 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-867f37e2-01eb-48c6-aca3-6f016ed2ae07 req-14a7eab8-65d4-471b-a416-4a2571924d8e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:26.157165 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-867f37e2-01eb-48c6-aca3-6f016ed2ae07 req-14a7eab8-65d4-471b-a416-4a2571924d8e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:26.170089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-867f37e2-01eb-48c6-aca3-6f016ed2ae07 req-14a7eab8-65d4-471b-a416-4a2571924d8e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:26.223470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-867f37e2-01eb-48c6-aca3-6f016ed2ae07 req-14a7eab8-65d4-471b-a416-4a2571924d8e service nova] Creating event network-vif-plugged:bcd222e7-b8b9-4f26-ba2d-337995705322 for instance 71714c3b-cd6f-413e-a16b-e97161abd750 on hv-cinder-85426 Aug 29 21:34:26.240653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-867f37e2-01eb-48c6-aca3-6f016ed2ae07 req-14a7eab8-65d4-471b-a416-4a2571924d8e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.555225 Aug 29 21:34:26.245766 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 36/73] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:26.367748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:26.369274 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:26.385990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:26.386412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:26.386863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:26.387594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:26.388055 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:26.388554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:26.495362 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:26.507407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7ecd2113-c40b-4d61-ad1c-55b79ab5fca1 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 0.515779 Aug 29 21:34:26.509072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 38/74] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:25 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:26.708904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:26.710458 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=4 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:26.711017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:26.744461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:26.744699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:26.751262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:26.757872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:26.764106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:26.767028 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:26.871328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:26.884880 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-00530dad-52d4-4ba5-85d7-4819793a4e57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 0.522985 Aug 29 21:34:26.888640 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 37/75] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:26 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:27.010992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f0404fa9-027a-47bd-a8c6-50f49cb203fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:27.011445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f0404fa9-027a-47bd-a8c6-50f49cb203fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:27.273506 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f0404fa9-027a-47bd-a8c6-50f49cb203fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:27.295124 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f0404fa9-027a-47bd-a8c6-50f49cb203fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1242 microversion: 2.1 time: 0.288561 Aug 29 21:34:27.300290 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 38/76] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:27 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1242 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:27.342747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:27.370112 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-72782ede-e7e4-49ff-a826-1d9a90d50baa tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1362 microversion: 2.1 time: 0.665631 Aug 29 21:34:27.390837 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 39/77] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:26 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1362 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:27.533644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:27.534470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:27.552182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.556922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.570207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:27.570207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.570207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.570207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:27.918423 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:27.920980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:27.954727 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.957911 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.960778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:27.962423 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:27.965874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:27.966684 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.071674 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:28.091413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-42542540-2ab4-4853-ae30-8f6aa3f28042 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 0.562671 Aug 29 21:34:28.114618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 39/78] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:27 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:28.299505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-423726be-2ad9-4f92-a43e-cb9e2ea5e38f req-b36357de-e8a6-4bc7-9148-d7c86df07790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e39fe9-0de6-4578-b311-5a3a0b68b4bb", "name": "network-vif-plugged", "status": "completed", "tag": "1f9fa908-44cc-46c6-859f-62b67ba01880"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:28.320393 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-423726be-2ad9-4f92-a43e-cb9e2ea5e38f req-b36357de-e8a6-4bc7-9148-d7c86df07790 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.321120 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-423726be-2ad9-4f92-a43e-cb9e2ea5e38f req-b36357de-e8a6-4bc7-9148-d7c86df07790 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.323944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-423726be-2ad9-4f92-a43e-cb9e2ea5e38f req-b36357de-e8a6-4bc7-9148-d7c86df07790 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.345161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-423726be-2ad9-4f92-a43e-cb9e2ea5e38f req-b36357de-e8a6-4bc7-9148-d7c86df07790 service nova] Creating event network-vif-plugged:1f9fa908-44cc-46c6-859f-62b67ba01880 for instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb on hv-cinder-85426 Aug 29 21:34:28.363955 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-423726be-2ad9-4f92-a43e-cb9e2ea5e38f req-b36357de-e8a6-4bc7-9148-d7c86df07790 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066891 Aug 29 21:34:28.367631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 40/79] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:28.379889 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:28.380757 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:28.382546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:28.400282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.403181 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.406355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.407462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.407978 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1354fe71-13f4-4a9b-9412-99e9a4492b34 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 0.499347 Aug 29 21:34:28.410067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 40/80] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:27 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:28.423155 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:28.424190 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:28.437815 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.441703 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.465899 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.468354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.469648 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.472423 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.475194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.478860 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.839081 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:28.850165 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-aa99a462-ba53-4110-99a3-395852290a00 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1294 microversion: 2.1 time: 0.481215 Aug 29 21:34:28.852360 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 41/81] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:28 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1294 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:28.866989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-9845fbca-55e7-44f2-99af-4d2043d48cc8 req-e3506844-fa54-40f6-99b9-5f1d55b931b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d", "tag": "61ca404f-f22e-487f-89c8-418db1d3a29d"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:28.890727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-9845fbca-55e7-44f2-99af-4d2043d48cc8 req-e3506844-fa54-40f6-99b9-5f1d55b931b3 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:28.891345 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-9845fbca-55e7-44f2-99af-4d2043d48cc8 req-e3506844-fa54-40f6-99b9-5f1d55b931b3 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:28.891773 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-9845fbca-55e7-44f2-99af-4d2043d48cc8 req-e3506844-fa54-40f6-99b9-5f1d55b931b3 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:28.907873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-9845fbca-55e7-44f2-99af-4d2043d48cc8 req-e3506844-fa54-40f6-99b9-5f1d55b931b3 service nova] Creating event network-changed:61ca404f-f22e-487f-89c8-418db1d3a29d for instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d on hv-cinder-85426 Aug 29 21:34:28.914306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-9845fbca-55e7-44f2-99af-4d2043d48cc8 req-e3506844-fa54-40f6-99b9-5f1d55b931b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060683 Aug 29 21:34:28.916097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 42/82] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:28.985217 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:29.005544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-26d1e3b7-45ce-4d0d-bc46-319d94eb8962 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1362 microversion: 2.1 time: 0.590558 Aug 29 21:34:29.008658 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 41/83] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:28 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1362 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:29.121183 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:29.122317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:29.138430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.140819 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.141879 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:29.144282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.144959 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.148954 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:29.440719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:29.441727 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:29.457385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.461070 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.462303 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:29.467970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.469133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.470938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:29.551242 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:29.563758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9c1be677-b5ba-4742-946c-6ebcf3c98dbf tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 0.445941 Aug 29 21:34:29.563758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 43/84] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:29 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:29.693675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:29.704137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-62532bb4-573c-494b-aaa9-711dbaae6dd0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1322 microversion: 2.1 time: 0.268749 Aug 29 21:34:29.704712 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 42/85] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:29 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:29.880335 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:29.881748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:29.894814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.895577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.896918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:29.898327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:29.899109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:29.899811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:30.041602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:30.043278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:30.056084 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:30.058180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:30.058953 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:30.062207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:30.063079 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:30.063820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:30.267450 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:30.281200 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ede7a42a-fb63-42eb-9863-166e8de6d0b2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1300 microversion: 2.1 time: 0.406519 Aug 29 21:34:30.295432 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 44/86] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:29 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1300 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:30.580132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-dbec026f-62b2-4e51-a6b2-a4d8a46d14d6 req-f1a038d3-19aa-4034-9b0b-db8e5468d21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad", "name": "network-vif-plugged", "status": "completed", "tag": "41fa18fd-119a-4c3b-adab-d7a7816c2f11"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:30.607844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-dbec026f-62b2-4e51-a6b2-a4d8a46d14d6 req-f1a038d3-19aa-4034-9b0b-db8e5468d21b service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:30.608418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-dbec026f-62b2-4e51-a6b2-a4d8a46d14d6 req-f1a038d3-19aa-4034-9b0b-db8e5468d21b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:30.610636 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-dbec026f-62b2-4e51-a6b2-a4d8a46d14d6 req-f1a038d3-19aa-4034-9b0b-db8e5468d21b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:30.628464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:30.675090 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-dbec026f-62b2-4e51-a6b2-a4d8a46d14d6 req-f1a038d3-19aa-4034-9b0b-db8e5468d21b service nova] Creating event network-vif-plugged:41fa18fd-119a-4c3b-adab-d7a7816c2f11 for instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad on hv-cinder-85426 Aug 29 21:34:30.708931 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-dbec026f-62b2-4e51-a6b2-a4d8a46d14d6 req-f1a038d3-19aa-4034-9b0b-db8e5468d21b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119618 Aug 29 21:34:30.713994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 45/87] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:30.741992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:30.751401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:30.767794 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:30.768700 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:30.769445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:30.771587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:30.772790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:30.773749 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:31.142410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:31.160438 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-48fc06d9-092a-479a-a5e9-2522fb040f5e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1362 microversion: 2.1 time: 1.126014 Aug 29 21:34:31.176794 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 43/88] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:30 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1362 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:31.200402 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:31.201749 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:31.219194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:31.220392 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:31.220851 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:31.221587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:31.224789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:31.225317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:31.316309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:31.326724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-34307ecb-ec3a-4b50-a190-24f0dcdada9f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 0.610580 Aug 29 21:34:31.327644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 46/89] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:30 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:31.349374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:31.350194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:31.366490 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:31.367452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:31.368326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:31.370267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:31.371171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:31.372104 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:31.489438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:31.507160 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-da015d74-54a9-4281-956e-64480898f4cc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1300 microversion: 2.1 time: 0.178201 Aug 29 21:34:31.520446 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 47/90] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:31 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1300 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:31.528293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:31.553581 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c52b9b3c-b53a-49cf-8f30-2ce183065349 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1516 microversion: 2.1 time: 0.374127 Aug 29 21:34:31.555850 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 44/91] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:31 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1516 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:31.590526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:31.594041 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:31.605125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:31.605675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:31.606135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:31.607172 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:31.608053 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:31.608514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:31.711516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'flavor' on Instance uuid 19e39fe9-0de6-4578-b311-5a3a0b68b4bb {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:34:32.091149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f6c069cd-1913-4c3d-891c-0d3d59acd717 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb/action" status: 200 len: 32 microversion: 2.1 time: 0.505291 Aug 29 21:34:32.098653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 48/92] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:34:31 2022] POST /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb/action => generated 32 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:34:32.104252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:32.105059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:32.129930 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.131494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.133514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.135985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.136795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.138651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.201418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:32.203067 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:32.253341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.260024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.269940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.274312 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:32.276617 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:32.278180 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:32.995992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:33.019817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-175c1eaf-e499-48f4-a5fe-5485c1bccf01 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1362 microversion: 2.1 time: 0.824570 Aug 29 21:34:33.020429 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 49/93] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:32 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1362 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:33.048459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:33.050095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:33.084669 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.086636 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.087806 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:33.089709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.090751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.093249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:33.178888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:33.204279 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-daffde60-d2d4-4535-91ab-2c3bbabe844d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 1.097932 Aug 29 21:34:33.207056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 45/94] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:32 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:33.232114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:33.233239 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:33.306862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.307798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.308601 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:33.313717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:33.314255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:33.314706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.023800 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:34.039824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b8674b42-b740-4d78-93c7-8ad4146a8484 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1313 microversion: 2.1 time: 0.998758 Aug 29 21:34:34.041021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 50/95] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:33 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1313 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:34.053102 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:34.055463 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:34.077320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:34.078672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:34.080006 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.081856 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:34.084423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:34.085983 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.125674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:34.140702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-24c1c6b5-ba06-420c-bc4b-7d000ebd06cd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.931929 Aug 29 21:34:34.141616 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 46/96] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:33 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:34.231480 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:34.242388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:34.268890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:34.269687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:34.271577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.272108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:34.272892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:34.273644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.865478 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:34.886024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2b56d692-89ad-45eb-a00e-0e99cd2fa0e1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1362 microversion: 2.1 time: 0.841379 Aug 29 21:34:34.901866 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 51/97] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:34 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1362 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:34.901866 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-0bb29e40-98d1-4973-9910-7a5e40cc0ca9 req-5d2de54d-5071-47a6-8159-0517911dbffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d", "name": "network-vif-plugged", "status": "completed", "tag": "61ca404f-f22e-487f-89c8-418db1d3a29d"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:34.918368 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-0bb29e40-98d1-4973-9910-7a5e40cc0ca9 req-5d2de54d-5071-47a6-8159-0517911dbffe service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:34.919649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-0bb29e40-98d1-4973-9910-7a5e40cc0ca9 req-5d2de54d-5071-47a6-8159-0517911dbffe service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:34.920272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-0bb29e40-98d1-4973-9910-7a5e40cc0ca9 req-5d2de54d-5071-47a6-8159-0517911dbffe service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:34.961141 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-0bb29e40-98d1-4973-9910-7a5e40cc0ca9 req-5d2de54d-5071-47a6-8159-0517911dbffe service nova] Creating event network-vif-plugged:61ca404f-f22e-487f-89c8-418db1d3a29d for instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d on hv-cinder-85426 Aug 29 21:34:35.006737 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-0bb29e40-98d1-4973-9910-7a5e40cc0ca9 req-5d2de54d-5071-47a6-8159-0517911dbffe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109951 Aug 29 21:34:35.011808 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 52/98] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:35.076390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:35.082053 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:35.085123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:35.113373 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6b11ba42-e07e-4ebc-9d9b-00ac2543b6f2 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.886631 Aug 29 21:34:35.114289 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 47/99] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:34 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:35.117080 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.119414 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.124569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.128197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.131716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.134182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.167185 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:35.169510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:35.212069 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.213237 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.213927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.216059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.219772 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.223521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.631191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:35.855543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:35.864087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-98de8fc2-09f2-4157-a0b8-fcf5fbf500c5 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1500 microversion: 2.1 time: 0.789055 Aug 29 21:34:35.886337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 53/100] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:35 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1500 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:35.924176 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:35.924926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:35.948719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.949399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.949998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.950869 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:35.951348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:35.951787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:35.984609 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=14 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:36.235832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:36.250705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c2e2697b-7a28-4e9b-825d-d104dacfbf19 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 1.086791 Aug 29 21:34:36.267157 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 48/101] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:35 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:36.278897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:36.279743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:36.288444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:36.289633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:36.291019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:36.294002 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:36.295580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:36.312968 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:36.351855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=100 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:36.832280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:36.883466 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a337ec24-bf5b-45da-bad7-231d8698c741 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1362 microversion: 2.1 time: 0.962748 Aug 29 21:34:36.914990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 54/102] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:35 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1362 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:36.929428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-dde1c433-80ea-4bfc-b043-58fcbbd75a83 req-1ced20eb-c5bc-4242-9181-7bd5141e5e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85c8e78-15e9-492f-b705-c725ff867ed0", "tag": "49318983-234b-42f9-9a16-3528f5def815"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:36.974036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-dde1c433-80ea-4bfc-b043-58fcbbd75a83 req-1ced20eb-c5bc-4242-9181-7bd5141e5e0a service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:36.978957 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-dde1c433-80ea-4bfc-b043-58fcbbd75a83 req-1ced20eb-c5bc-4242-9181-7bd5141e5e0a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:36.979469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-dde1c433-80ea-4bfc-b043-58fcbbd75a83 req-1ced20eb-c5bc-4242-9181-7bd5141e5e0a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.018584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:37.037289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-dde1c433-80ea-4bfc-b043-58fcbbd75a83 req-1ced20eb-c5bc-4242-9181-7bd5141e5e0a service nova] Creating event network-changed:49318983-234b-42f9-9a16-3528f5def815 for instance d85c8e78-15e9-492f-b705-c725ff867ed0 on hv-cinder-85426 Aug 29 21:34:37.054181 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-dde1c433-80ea-4bfc-b043-58fcbbd75a83 req-1ced20eb-c5bc-4242-9181-7bd5141e5e0a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133751 Aug 29 21:34:37.055067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-18bd750c-d1fc-4a3c-9dc9-9395c68b8814 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.781903 Aug 29 21:34:37.055283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 55/103] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:37.058457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 49/104] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:36 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:37.282743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:37.286582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:37.300625 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=16 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:37.305041 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.305542 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.306011 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.306726 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.307180 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.307608 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.631108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43a38f04-fcbc-41b3-a603-9a636650e288"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:37.638902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:37.666777 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.668009 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.669708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.672493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:37.673758 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:37.674847 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:37.994505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:38.015873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-39ee19ec-8f06-4dbc-b33f-dbc8d2fce033 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.740301 Aug 29 21:34:38.031844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 56/105] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:37 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:38.043091 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:38.044121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:38.055351 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.056103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.056741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.062394 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.063086 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.063677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.575561 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-64f7629d-2bb0-4924-a234-c76e8be2c9df tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "POST /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.962687 Aug 29 21:34:38.576371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 50/106] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:34:37 2022] POST /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad/os-volume_attachments => generated 194 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:38.604055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:38.607220 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:38.634872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.638982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.639741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.640666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.641455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.642054 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.891588 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:38.904188 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cf760a27-8d8d-42dc-8882-899570343976 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1549 microversion: 2.1 time: 0.871383 Aug 29 21:34:38.919719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 57/107] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:38 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1549 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:38.941491 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:38.944494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:38.963146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.967107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.968373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:38.984422 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:38.985663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:38.986544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.172809 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:39.199136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7665a4db-cb26-4e9e-846a-01c83d8452ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.618970 Aug 29 21:34:39.202038 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 51/108] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:38 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:39.222248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:39.224646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:39.229941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-aefcd220-5021-44a6-9931-d716a28526a4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296126 Aug 29 21:34:39.231493 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 58/109] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:34:38 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-interface => generated 285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:39.248119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.254411 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.256391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.260515 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:39.262750 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:39.263485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:39.785137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:39.814671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5815e244-46b3-47b3-901b-c161feccfdab tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.607810 Aug 29 21:34:39.815744 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 52/110] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:39 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:40.232857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:40.234207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:40.244507 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.245472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.248124 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:40.249087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.250875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.251498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:40.859603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:40.860620 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:40.883293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.883929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.884365 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:40.886681 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:40.887860 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:40.888801 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:41.216164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:41.254543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a44abd9b-7d0c-461d-9efd-b8539d246cb3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 1.026780 Aug 29 21:34:41.258417 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 59/111] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:40 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:41.562136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:41.579918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f1b48fbb-86d0-430f-ac2b-ff13e89bc982 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.719214 Aug 29 21:34:41.594834 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 53/112] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:40 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:42.021893 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-22458eaa-50cc-4dc3-9526-3429317bc3ad req-4dadccf2-05a6-404e-abaa-d6b98cdaf8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d", "tag": "61ca404f-f22e-487f-89c8-418db1d3a29d"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:42.039913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-22458eaa-50cc-4dc3-9526-3429317bc3ad req-4dadccf2-05a6-404e-abaa-d6b98cdaf8c9 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.042114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-22458eaa-50cc-4dc3-9526-3429317bc3ad req-4dadccf2-05a6-404e-abaa-d6b98cdaf8c9 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.045587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-22458eaa-50cc-4dc3-9526-3429317bc3ad req-4dadccf2-05a6-404e-abaa-d6b98cdaf8c9 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.081419 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-22458eaa-50cc-4dc3-9526-3429317bc3ad req-4dadccf2-05a6-404e-abaa-d6b98cdaf8c9 service nova] Creating event network-changed:61ca404f-f22e-487f-89c8-418db1d3a29d for instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d on hv-cinder-85426 Aug 29 21:34:42.093948 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-22458eaa-50cc-4dc3-9526-3429317bc3ad req-4dadccf2-05a6-404e-abaa-d6b98cdaf8c9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071107 Aug 29 21:34:42.094712 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 60/113] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:42.323798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:42.326266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:42.371670 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.374532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.376526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.384874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.387265 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.391333 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.607756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:42.608677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:42.626149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.630670 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.632666 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:42.636700 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:42.637202 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:42.638806 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:43.346443 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:43.358572 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-fa836d12-976d-4200-a3d2-b7651da5f65e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.756540 Aug 29 21:34:43.376521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 61/114] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:42 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:43.454712 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:43.468019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-29d148d0-4792-4c47-9a41-a0b088b76d09 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 1.152231 Aug 29 21:34:43.470214 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 54/115] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:42 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:44.409552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:44.410843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:44.422643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.423992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.425003 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.427055 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.428156 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.429203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.497102 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:44.503600 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:44.530084 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.531390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.532412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.533953 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:44.534966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:44.536516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:44.986225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:44.991455 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:45.000965 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b7f5b664-cd2e-4b4e-9a56-8e41475d39b1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.598816 Aug 29 21:34:45.003347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 62/116] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:44 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:45.123954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:45.165188 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-07272ed8-188a-43ec-96ff-2b4be61ff5f3 req-04d2357f-f6c5-4419-b131-23e963ec441b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85c8e78-15e9-492f-b705-c725ff867ed0", "name": "network-vif-plugged", "status": "completed", "tag": "49318983-234b-42f9-9a16-3528f5def815"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:45.165412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-db39fa3b-c6e5-4e21-8d1b-867d15f032d5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.675918 Aug 29 21:34:45.186105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 55/117] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:44 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:45.204171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-07272ed8-188a-43ec-96ff-2b4be61ff5f3 req-04d2357f-f6c5-4419-b131-23e963ec441b service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:45.204657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-07272ed8-188a-43ec-96ff-2b4be61ff5f3 req-04d2357f-f6c5-4419-b131-23e963ec441b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:45.206796 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-07272ed8-188a-43ec-96ff-2b4be61ff5f3 req-04d2357f-f6c5-4419-b131-23e963ec441b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:45.253253 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-07272ed8-188a-43ec-96ff-2b4be61ff5f3 req-04d2357f-f6c5-4419-b131-23e963ec441b service nova] Creating event network-vif-plugged:49318983-234b-42f9-9a16-3528f5def815 for instance d85c8e78-15e9-492f-b705-c725ff867ed0 on hv-cinder-85426 Aug 29 21:34:45.273574 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-07272ed8-188a-43ec-96ff-2b4be61ff5f3 req-04d2357f-f6c5-4419-b131-23e963ec441b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112967 Aug 29 21:34:45.278099 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 63/118] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:46.042840 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:46.043713 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:46.055089 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.056231 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.057048 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.058295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.059054 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.059784 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.203946 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:46.206361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:46.220391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.221077 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.221880 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.223751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:46.225097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:46.225853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:46.420252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.447996 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9fb97238-91ce-4f7c-aaeb-f913351993ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.406859 Aug 29 21:34:46.459192 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 56/119] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:46 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:46.483115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:46.491695 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a252fd4c-15fd-4cb0-9898-24d0e42ecd7e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.295069 Aug 29 21:34:46.492270 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 64/120] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:46 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:47.487836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:47.489328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:47.519850 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:47.521322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:47.527696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.536456 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.537519 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:47.539719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.540593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.545332 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:47.553093 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.554249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.559587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:47.566546 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:47.569402 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:47.570034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:47.914543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:47.922261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:47.930411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-df47e0e9-2845-4de1-89a9-66683e5556bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.419430 Aug 29 21:34:47.931486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 65/121] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:47 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:47.936988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-93062c55-5dea-4bb4-b732-6db853a0450e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.453270 Aug 29 21:34:47.952776 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 57/122] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:47 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:48.964379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:48.966051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:48.966961 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:48.967604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:48.971882 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:48.981619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.983042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.986330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.987886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.990173 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.991197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:48.993929 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:48.999414 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:48.999979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.000739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:49.001246 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:49.001680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:49.345677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:49.361755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4ac8f446-54f3-4e34-a4a2-4f2dbbcff22c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.406134 Aug 29 21:34:49.362907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 66/123] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:48 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:49.426990 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:49.448993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-32e393ff-a47a-47b6-b3dd-4578703b221d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1368 microversion: 2.1 time: 0.489008 Aug 29 21:34:49.451717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 58/124] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:48 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1368 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:50.415403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:50.418531 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:50.427060 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=82 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:50.448955 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.459014 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.460272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.462977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.463799 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.464237 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.482698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:50.483846 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:50.512967 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.514865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.515606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.518624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.519162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.519581 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.741727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:50.752980 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-fc946340-1102-42b6-a57d-c4bdc53ee66b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.346980 Aug 29 21:34:50.756778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 67/125] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:50 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:50.762647 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:50.763142 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:50.774572 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.775578 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.776840 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.778148 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.779239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.779669 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.783938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:50.794914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7e6f0ac2-e9aa-45c4-baea-5813121d310c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1558 microversion: 2.1 time: 0.320580 Aug 29 21:34:50.795495 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 59/126] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:50 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1558 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:50.822575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:50.824072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:50.830415 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.830950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:34:50.831743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.832623 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.833542 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:50.834223 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:50.834860 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:50.951574 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-79f7bc2d-7cea-4a3d-897a-dde08099917f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133331 Aug 29 21:34:50.952456 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 60/127] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:34:50 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:50.989915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cbdcdba8-d2c9-417c-97cc-9e0621732c3d tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 204 len: 0 microversion: 2.1 time: 0.230754 Aug 29 21:34:50.991005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 68/128] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:34:50 2022] DELETE /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:34:51.000609 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:51.001326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:51.008669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.009232 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.010144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.011646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.012180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.012826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.227497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:51.242221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c21de311-0603-42d8-8056-53bb87dc276f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1552 microversion: 2.1 time: 0.245029 Aug 29 21:34:51.244934 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 61/129] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:50 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1552 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:51.779703 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:51.780644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:51.808041 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.810645 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.811785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:51.813448 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:51.819098 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:51.819642 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.045870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:52.074233 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2262b743-2a64-49c4-bf7c-93fa37c28614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.302389 Aug 29 21:34:52.077186 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 69/130] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:51 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:52.272759 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:52.273825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:52.284970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.286169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.286878 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.287793 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.288748 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.289445 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.522611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-386aceab-ad60-4ce1-a0ae-2fae85fd876e req-cebe0256-df7a-4b7f-b178-06dca56f6ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85c8e78-15e9-492f-b705-c725ff867ed0", "tag": "49318983-234b-42f9-9a16-3528f5def815"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:52.534030 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:52.545079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-386aceab-ad60-4ce1-a0ae-2fae85fd876e req-cebe0256-df7a-4b7f-b178-06dca56f6ebf service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:52.546327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-386aceab-ad60-4ce1-a0ae-2fae85fd876e req-cebe0256-df7a-4b7f-b178-06dca56f6ebf service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:52.547299 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-386aceab-ad60-4ce1-a0ae-2fae85fd876e req-cebe0256-df7a-4b7f-b178-06dca56f6ebf service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:52.548893 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b880ec33-560a-419d-af01-d07d6cd4928c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1552 microversion: 2.1 time: 0.283476 Aug 29 21:34:52.550422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 62/131] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:52 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1552 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:52.580789 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-386aceab-ad60-4ce1-a0ae-2fae85fd876e req-cebe0256-df7a-4b7f-b178-06dca56f6ebf service nova] Creating event network-changed:49318983-234b-42f9-9a16-3528f5def815 for instance d85c8e78-15e9-492f-b705-c725ff867ed0 on hv-cinder-85426 Aug 29 21:34:52.590399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-386aceab-ad60-4ce1-a0ae-2fae85fd876e req-cebe0256-df7a-4b7f-b178-06dca56f6ebf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075989 Aug 29 21:34:52.591881 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 70/132] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:34:53.108914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:53.109719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:53.127053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.132359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.133077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:53.134089 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.134866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.135431 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:53.595579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:53.596761 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:53.631699 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.633081 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.634912 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:53.637857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:53.638591 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:53.640336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:54.477610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:54.518676 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-12dfc666-c76b-4dee-8bea-bdf3583a8b71 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 1.411851 Aug 29 21:34:54.523706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 63/133] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:53 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:34:54.689488 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:54.716808 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6326959d-b44b-438c-b4ae-3a53122d336f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1552 microversion: 2.1 time: 1.134650 Aug 29 21:34:54.721490 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 71/134] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:53 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1552 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:55.353499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-d3f8526e-956c-4a54-8d0a-e032c025f5ba req-283ae6c5-38d8-4da5-88af-6fd61ef451b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad", "name": "network-vif-deleted", "tag": "41fa18fd-119a-4c3b-adab-d7a7816c2f11"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:34:55.387629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-d3f8526e-956c-4a54-8d0a-e032c025f5ba req-283ae6c5-38d8-4da5-88af-6fd61ef451b1 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.391141 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-d3f8526e-956c-4a54-8d0a-e032c025f5ba req-283ae6c5-38d8-4da5-88af-6fd61ef451b1 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.395626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-d3f8526e-956c-4a54-8d0a-e032c025f5ba req-283ae6c5-38d8-4da5-88af-6fd61ef451b1 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.421413 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-d3f8526e-956c-4a54-8d0a-e032c025f5ba req-283ae6c5-38d8-4da5-88af-6fd61ef451b1 service nova] Creating event network-vif-deleted:41fa18fd-119a-4c3b-adab-d7a7816c2f11 for instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad on hv-cinder-85426 Aug 29 21:34:55.430017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-d3f8526e-956c-4a54-8d0a-e032c025f5ba req-283ae6c5-38d8-4da5-88af-6fd61ef451b1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087136 Aug 29 21:34:55.432690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 64/135] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:34:55.553507 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:55.554778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:55.567081 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.568585 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.569676 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.571303 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.572470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.573331 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.757177 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:55.764824 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:55.773291 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.773898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.782144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.782903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:55.783489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:55.783925 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:55.999907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3a0e28dc247b5a7ee9434a4d6554c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71f4912b8f1b4a5199fe6d11315c2658', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:56.002709 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:34:56.029662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-51d3a037-dd7e-4689-90d1-d2f6945b8b9c tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 200 len: 1344 microversion: 2.1 time: 0.274288 Aug 29 21:34:56.032105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 65/136] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:55 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 1344 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:56.063979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:56.104503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bc99f682-503b-4dbb-8f39-ca162442e32a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.559911 Aug 29 21:34:56.106054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 72/137] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:55 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:57.070532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:57.071545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:57.082094 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.082916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.083643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.084818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.085593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.086382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.108963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] HTTP exception thrown: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Request method failure captured: Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad HTTP/1.1 Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDG0kFmYDOTEXqqzqcMbwcl7W3cuhHlG4VyNaOZwyp8d579Ge7TGHef8-eucrB9f_OcJhVPVqEikXRxDkLLTOi8LZqp2X3OhRHeC1y2d6iD1Z4u6RzZEyfRbxRoUgT14U1u7ZdfmnW_9stnfWy2LvlxtSPscgdsZAe3PTDiiKaBusw Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:34:57.118010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_71f4912b8f1b4a5199fe6d11315c2658", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-DeleteServersTestJSON-746875201 Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 96d3a0e28dc247b5a7ee9434a4d6554c Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.119580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad'} Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:57.120391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.124481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.127000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Returning 404 to user: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:57.127000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c9fe36e1-a347-454a-bff0-9629904c886f tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 404 len: 111 microversion: 2.1 time: 0.057347 Aug 29 21:34:57.127000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 66/138] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:57 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:57.147421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:57.148188 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:57.162459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.162956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.163394 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.164095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.164547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.164965 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.309546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:57.311949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:57.323202 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.324045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.324720 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.325595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:57.335855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:57.337647 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:57.377612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] HTTP exception thrown: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Request method failure captured: Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad/os-volume_attachments HTTP/1.1 Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDG0kFmYDOTEXqqzqcMbwcl7W3cuhHlG4VyNaOZwyp8d579Ge7TGHef8-eucrB9f_OcJhVPVqEikXRxDkLLTOi8LZqp2X3OhRHeC1y2d6iD1Z4u6RzZEyfRbxRoUgT14U1u7ZdfmnW_9stnfWy2LvlxtSPscgdsZAe3PTDiiKaBusw Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:34:57.380398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_71f4912b8f1b4a5199fe6d11315c2658", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-DeleteServersTestJSON-746875201 Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 96d3a0e28dc247b5a7ee9434a4d6554c Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.382354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'server_id': '2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad'} Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:34:57.383773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:34:57.390092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:34:57.396488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Returning 404 to user: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:34:57.396488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a5bf090d-aac3-4c97-b327-523f079d75d9 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077843 Aug 29 21:34:57.396488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 67/139] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:34:57 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad/os-volume_attachments => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:34:57.404421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:57.416091 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-583eafbc-2287-4324-8d08-58918c997956 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.273886 Aug 29 21:34:57.430070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 73/140] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:57 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:58.438392 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:58.439169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:58.446578 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.447375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.449145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.449325 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:58.450034 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:58.450763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:58.662976 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:58.671398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0702813e-5e18-47b9-b889-1ab8e678e243 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.237631 Aug 29 21:34:58.671972 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 68/141] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:58 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:34:59.704675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:34:59.706168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:34:59.718547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.719168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.719729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.720463 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:34:59.721055 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:34:59.721614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:34:59.892825 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:34:59.902044 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9cda7528-35b1-4aa5-8758-5b68414dde95 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.205252 Aug 29 21:34:59.902683 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 74/142] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:34:59 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:00.938931 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:00.940617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:00.949114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.949628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.950115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:00.950957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:00.951461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:00.952072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.048955 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:01.051431 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:01.057776 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.058854 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.059615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.060815 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.061627 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.062648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.085324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] HTTP exception thrown: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Request method failure captured: Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: DELETE /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad HTTP/1.1 Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDG0kFmYDOTEXqqzqcMbwcl7W3cuhHlG4VyNaOZwyp8d579Ge7TGHef8-eucrB9f_OcJhVPVqEikXRxDkLLTOi8LZqp2X3OhRHeC1y2d6iD1Z4u6RzZEyfRbxRoUgT14U1u7ZdfmnW_9stnfWy2LvlxtSPscgdsZAe3PTDiiKaBusw Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:35:01.091005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_71f4912b8f1b4a5199fe6d11315c2658", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-DeleteServersTestJSON-746875201 Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 96d3a0e28dc247b5a7ee9434a4d6554c Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.092416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad'} Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:01.093071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.094194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.096843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Returning 404 to user: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:01.098708 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8b53e90d-b735-495b-a3de-99348fd3f969 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 404 len: 111 microversion: 2.1 time: 0.053942 Aug 29 21:35:01.099798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 75/143] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:35:01 2022] DELETE /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:35:01.111695 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:01.112410 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] [instance: 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:01.124899 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.125967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.127553 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.127942 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:01.128756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:01.129568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:01.147470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] HTTP exception thrown: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Request method failure captured: Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad HTTP/1.1 Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDG0kFmYDOTEXqqzqcMbwcl7W3cuhHlG4VyNaOZwyp8d579Ge7TGHef8-eucrB9f_OcJhVPVqEikXRxDkLLTOi8LZqp2X3OhRHeC1y2d6iD1Z4u6RzZEyfRbxRoUgT14U1u7ZdfmnW_9stnfWy2LvlxtSPscgdsZAe3PTDiiKaBusw Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:35:01.149121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/71f4912b8f1b4a5199fe6d11315c2658"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_71f4912b8f1b4a5199fe6d11315c2658", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-DeleteServersTestJSON-746875201 Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 71f4912b8f1b4a5199fe6d11315c2658 Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-DeleteServersTestJSON-746875201 Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 96d3a0e28dc247b5a7ee9434a4d6554c Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-DeleteServersTestJSON-746875201-project Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.151389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad'} Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:01.152691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. Aug 29 21:35:01.154743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:01.156905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] Returning 404 to user: Instance 2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:01.156905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1924af87-41de-4a86-8b42-521e50d16de6 tempest-DeleteServersTestJSON-746875201 tempest-DeleteServersTestJSON-746875201-project] 10.222.0.90 "GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad" status: 404 len: 111 microversion: 2.1 time: 0.045189 Aug 29 21:35:01.156905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 76/144] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:01 2022] GET /compute/v2.1/servers/2a8f4ce8-eae0-4c8b-9971-e3682aa3b3ad => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:35:01.170857 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:01.182828 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-952ddcc1-ee7b-4693-9691-9546048a36a4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.249670 Aug 29 21:35:01.184483 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 69/145] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:00 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:02.235177 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:02.235897 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:02.248778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.249273 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.249718 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:02.250455 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:02.250944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:02.251374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:02.482280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:02.499134 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e9a722bb-9465-4460-ba89-788c4e2c2b3d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.280651 Aug 29 21:35:02.502354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 77/146] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:02 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:03.537954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:03.540092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:03.555624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:03.557404 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:03.558282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:03.559920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:03.560825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:03.561872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:04.022653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:04.037288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-afe85a26-79b4-4174-9d66-792f3f0113a9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.512559 Aug 29 21:35:04.038164 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 70/147] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:03 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:05.072759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:05.073757 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:05.105355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:05.106507 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:05.107192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:05.108761 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:05.109743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:05.110409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:05.544002 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:05.560377 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c2c50302-a185-4105-860e-b4dea0ea868f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.501946 Aug 29 21:35:05.561704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 78/148] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:05 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:06.597123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:06.601211 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:06.609021 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:06.609756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:06.610509 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:06.611577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:06.612334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:06.612836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:06.811889 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:06.834754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e6bb700a-502b-44a7-b741-9aaf5065577b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.244520 Aug 29 21:35:06.836205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 71/149] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:06 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:07.865076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:07.867297 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:07.883072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:07.887373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:07.888655 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:07.889974 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:07.892939 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:07.895875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:08.164267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:08.177817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-dbb43003-371e-4237-9a54-cc0994f66dcd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.316730 Aug 29 21:35:08.179109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 79/150] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:07 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:09.205173 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:09.208072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:09.237006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:09.238831 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:09.242795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:09.247842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:09.250853 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:09.251839 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:09.708848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:09.731535 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8fb23746-ea60-41b7-83a0-14df58926584 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.533230 Aug 29 21:35:09.732874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 72/151] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:09 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:10.766160 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:10.768704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:10.785269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:10.787774 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:10.788950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:10.790751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:10.792035 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:10.793490 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:10.852547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:11.243623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:11.259564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-981e7509-ae5e-4411-8098-fdb9e6a0388d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.503378 Aug 29 21:35:11.262004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 80/152] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:10 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:12.307808 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:12.309056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:12.323051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:12.324162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:12.325386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:12.327023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:12.336597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:12.338738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:12.661722 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:12.716458 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dbbf13db-0414-4eb7-87ed-7fe1b944f6cc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.413747 Aug 29 21:35:12.717386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 73/153] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:12 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:13.740247 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:13.741151 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:13.753064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:13.773204 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:13.774482 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:13.777298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:13.780309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:13.787820 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:14.266988 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:14.309584 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-679c2318-a1f4-4a4d-b16f-674081a2e218 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1522 microversion: 2.1 time: 0.571174 Aug 29 21:35:14.315854 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 81/154] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:13 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:15.344344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:15.348330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:15.384858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.388369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.392667 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:15.401328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.402904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.408964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:15.858596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:15.895760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6ab02924-90fd-478c-b528-300db5bab327 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1502 microversion: 2.1 time: 0.560863 Aug 29 21:35:15.910067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 74/155] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:15 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1502 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:15.924479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:15.925165 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:15.940225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.957808 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.958847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:15.965693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:15.966369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:15.967137 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:16.280667 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:16.299915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bdde4a53-de47-4f95-86b4-07143a81a79f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1515 microversion: 2.1 time: 0.380894 Aug 29 21:35:16.303268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 82/156] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:15 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1515 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:18.449105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:18.453951 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:18.464844 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.466057 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.467219 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.468930 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:18.470104 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:18.471155 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:18.524563 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'flavor' on Instance uuid 71714c3b-cd6f-413e-a16b-e97161abd750 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:35:18.952726 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ffcbd9a5-3d42-4410-b5b2-86721d1713fe tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750/action" status: 200 len: 32 microversion: 2.1 time: 0.509823 Aug 29 21:35:18.961045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 75/157] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:35:18 2022] POST /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750/action => generated 32 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:35:18.964864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-813084788", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:18.985566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:18.986738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:19.016032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:19.017644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:19.018404 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:19.019988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:19.020740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:19.021336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:19.154875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] validate_networks() for None {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:35:19.819278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:19.830203 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-17a5acfd-34b0-4e9e-9061-af84aee1cfd6 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.866707 Aug 29 21:35:19.831120 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 76/158] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:18 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:20.062423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:35:20.065377 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:35:20.065993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:35:20.066466 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:35:20.066951 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:35:20.100753 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:20.101565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:20.103111 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:20.107239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:20.108196 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:20.109897 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:20.145691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Getting quotas for project 2dd38d98e8f042b69c60978ea8e7742b. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:20.150691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Getting quotas for user 29a2a13867e7485590d34bb87b81d6f6 and project 2dd38d98e8f042b69c60978ea8e7742b. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:20.167373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:35:20.170442 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:35:20.280698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f656a450-084d-4976-b701-55740bf12694 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339428 Aug 29 21:35:20.292433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 83/159] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:35:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:35:20.304096 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-25c2cb16-635f-4cbc-bac9-50d8b52683b5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:20.305444 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-25c2cb16-635f-4cbc-bac9-50d8b52683b5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:20.433398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6fa65914-7aa3-4774-af59-cd07300aa117 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'create', calling method: .version_select at 0x7f8bdfaca040>, body: {"keypair": {"name": "tempest-keypair-203200048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3iGlxhejCii7w6Vd3lD1m33cLSMjBa7t0HJz79JR2hVkYifKUTUQmEzZXNbBYO+ELLm3TnvbPkQnLq5a1fA522eWAYbfMBpkJYHB6Qku8FpRy9IMMpHIsNDVW3lOONAg=="}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:20.501368 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=38 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:20.524557 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-25c2cb16-635f-4cbc-bac9-50d8b52683b5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:20.549921 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-25c2cb16-635f-4cbc-bac9-50d8b52683b5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1214 microversion: 2.1 time: 0.254504 Aug 29 21:35:20.562330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-6fa65914-7aa3-4774-af59-cd07300aa117 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for project 817ab3905c8541dc9c2bab51764984d0. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:20.566657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 84/160] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:20 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:20.578408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-6fa65914-7aa3-4774-af59-cd07300aa117 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for user b6a3df8d796e4ae6ac358f103903d427 and project 817ab3905c8541dc9c2bab51764984d0. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:20.679997 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6fa65914-7aa3-4774-af59-cd07300aa117 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.827429 Aug 29 21:35:20.681956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 77/161] 10.222.0.90 () {62 vars in 1200 bytes} [Mon Aug 29 21:35:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 831 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 21:35:20.884146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:20.885765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:20.895799 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:20.898440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:20.899613 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:20.901252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:20.902412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:20.903859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:20.904612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:21.259901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:21.273145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-13923455-c57a-425c-aa61-1fdc336ce0fc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.420530 Aug 29 21:35:21.288632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 85/162] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:20 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:21.584850 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:21.585815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:21.651077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:21.651655 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:21.652098 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:21.652817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:21.656476 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:21.657286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:21.926632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:21.969813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d8359b36-51c8-4f63-a40c-cce2341aa1c3 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1210 microversion: 2.1 time: 0.392299 Aug 29 21:35:21.976133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 78/163] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:21 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1210 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:22.323655 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:22.326432 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:22.344242 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:22.345036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:22.349521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:22.353400 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:22.355452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:22.357321 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:22.747267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:22.775540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-00a0bf52-b0d5-423c-9f96-50722e44893c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.455915 Aug 29 21:35:22.781941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 86/164] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:22 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:23.002071 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:23.005950 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:23.047083 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:23.047614 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:23.049139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:23.051314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:23.055829 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:23.056299 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:23.522151 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:23.535789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5ea34614-6c61-4376-9763-6d315525b2e0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1274 microversion: 2.1 time: 0.538350 Aug 29 21:35:23.546598 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 79/165] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:22 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1274 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:23.810108 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:23.813101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:23.844568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:23.845425 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:23.854562 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:23.855837 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:23.856692 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:23.859249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:24.602315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:24.603732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:24.614504 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:24.615458 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:24.617541 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:24.618889 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:24.619864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:24.620549 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:24.832274 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:24.846881 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:24.868410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c96dc8b2-b64f-4878-b162-fb84e962e80a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1272 microversion: 2.1 time: 0.271201 Aug 29 21:35:24.874281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 80/166] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:24 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:24.891646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1114558288", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cc1dc57-ce5c-46cc-8752-8e1a426fca2b"}], "security_groups": [{"name": "tempest-securitygroup--1196690111"}], "key_name": "tempest-keypair-203200048", "user_data": "}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:24.895553 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6d05f7ac-b2ba-4609-a192-64f442c64f57 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 1.095121 Aug 29 21:35:24.896701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 87/167] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:23 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:25.171444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] validate_networks() for [('8cc1dc57-ce5c-46cc-8752-8e1a426fca2b', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:35:25.906570 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:25.907711 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:25.927373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:25.930569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:25.933482 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:25.937902 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:25.938842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:25.941183 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:26.519762 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:35:26.521944 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:35:26.524540 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:35:26.525757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:35:26.529177 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:35:26.563568 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:26.565595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:26.568474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:26.572805 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:26.576875 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:26.579158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:26.584671 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:26.603070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-32029c08-e79f-4e0f-8f33-88e99a49ce44 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.705177 Aug 29 21:35:26.603417 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:26.621741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 88/168] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:25 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:26.630467 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for project 817ab3905c8541dc9c2bab51764984d0. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:26.636129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for user b6a3df8d796e4ae6ac358f103903d427 and project 817ab3905c8541dc9c2bab51764984d0. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:26.648610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:26.651578 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:26.667429 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:26.668766 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:26.669702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:26.671302 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:26.672108 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:26.672977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:26.682286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:35:26.686522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:35:26.798021 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1a5c5a37-e59b-455f-9b23-c05dd8f4d5eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.918331 Aug 29 21:35:26.800130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 81/169] 10.222.0.90 () {62 vars in 1188 bytes} [Mon Aug 29 21:35:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 21:35:26.812447 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-18d9e0ea-eb65-4f93-9880-8ad2cd911f59 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:26.813589 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-18d9e0ea-eb65-4f93-9880-8ad2cd911f59 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:27.025547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-18d9e0ea-eb65-4f93-9880-8ad2cd911f59 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:27.042755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-18d9e0ea-eb65-4f93-9880-8ad2cd911f59 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:27.045899 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-18d9e0ea-eb65-4f93-9880-8ad2cd911f59 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:27.048649 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-18d9e0ea-eb65-4f93-9880-8ad2cd911f59 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1281 microversion: 2.20 time: 0.239977 Aug 29 21:35:27.049924 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 82/170] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:26 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:35:27.233829 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:27.246658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3a14cbe9-9847-4e98-aa73-8feb396006df tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.604662 Aug 29 21:35:27.262773 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 89/171] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:26 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:27.676242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:27.679147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:27.687292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:27.688091 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:27.688976 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:27.690108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:27.690720 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:27.691645 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:28.098359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:28.099742 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:28.111824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:28.118255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:28.119518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:28.121254 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:28.122445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:28.123390 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:28.172095 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:28.188567 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-58fd73c3-c324-4ac1-b9c4-715b21460bf0 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.548724 Aug 29 21:35:28.190789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 83/172] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:27 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:28.279869 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:28.283258 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:28.296868 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:28.301650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:28.303095 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:28.304820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:28.306166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:28.307399 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:28.317600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:28.351186 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:28.353536 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:28.355439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1e0dfcbb-3eef-4a39-b694-bcca9e8cacff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1333 microversion: 2.20 time: 0.264843 Aug 29 21:35:28.356569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 90/173] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:28 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1333 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:28.440849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-b5c55509-3368-4fd0-8799-4659e53eb8e2 req-a7e56dcb-ffa9-4452-a95f-019c0c101856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82034d8e-e8f3-430f-bef6-c41bf7a18706", "tag": "938f0e7d-9e6f-4fdc-8e6a-874e78872d6d"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:28.460424 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b5c55509-3368-4fd0-8799-4659e53eb8e2 req-a7e56dcb-ffa9-4452-a95f-019c0c101856 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:28.461337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b5c55509-3368-4fd0-8799-4659e53eb8e2 req-a7e56dcb-ffa9-4452-a95f-019c0c101856 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:28.466560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b5c55509-3368-4fd0-8799-4659e53eb8e2 req-a7e56dcb-ffa9-4452-a95f-019c0c101856 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:28.495838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-b5c55509-3368-4fd0-8799-4659e53eb8e2 req-a7e56dcb-ffa9-4452-a95f-019c0c101856 service nova] Creating event network-changed:938f0e7d-9e6f-4fdc-8e6a-874e78872d6d for instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 on hv-cinder-85426 Aug 29 21:35:28.504545 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-b5c55509-3368-4fd0-8799-4659e53eb8e2 req-a7e56dcb-ffa9-4452-a95f-019c0c101856 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074734 Aug 29 21:35:28.505300 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 91/174] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:28.681573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:28.690470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f07fd236-1833-4418-8c6b-53571d89e2db tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.419679 Aug 29 21:35:28.691901 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 84/175] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:28 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:29.220036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:29.222376 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:29.238805 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.240087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.241098 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:29.242578 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.243428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.244323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:29.404613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:29.405479 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:29.428059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.429762 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.431007 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:29.431862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.432856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.433357 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:29.618603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:29.634989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:29.647522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7bba6599-4c60-4e9d-8ee2-82c0f79d7f47 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.435510 Aug 29 21:35:29.648496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:29.649203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 92/176] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:29 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:29.652140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:29.654179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0ea36491-45f2-4dbe-97b2-cbcb08ce2b45 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1339 microversion: 2.20 time: 0.256173 Aug 29 21:35:29.660454 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 85/177] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:29 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1339 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:29.729305 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:29.730773 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:29.743194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.744299 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.745350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:29.746808 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:29.747607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:29.748410 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:30.053759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:30.077456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-08cfa4c8-d643-4adf-bd60-025cdf383b76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.356679 Aug 29 21:35:30.079438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 93/178] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:29 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:30.676428 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:30.683465 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:30.695172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:30.695670 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:30.696109 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:30.696819 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:30.697111 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:30.697579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:30.697672 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:30.698685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:30.705555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:30.706820 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=8 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:30.709298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:30.710160 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:30.710995 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:30.712257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:30.712919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:30.713536 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:31.389975 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:31.403421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a3e1fd05-9a86-40e5-97e6-4ceb5659e6fb tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.736084 Aug 29 21:35:31.418876 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 86/179] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:30 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:31.433118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:31.434261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:31.434505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:31.452341 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:31.454741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:31.455181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:31.457114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:31.457380 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:31.458035 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:31.468858 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:31.474516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:31.476911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-54ae766b-1373-45aa-b946-511438ca7165 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.784664 Aug 29 21:35:31.478728 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 94/180] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:30 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:31.897913 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:31.912067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bceecad5-ad2e-4edf-8046-ae67918a5c9c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.490902 Aug 29 21:35:31.924775 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 87/181] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:31 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:32.438148 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.439170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:32.454248 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:32.455691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:32.456641 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:32.457819 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:32.458586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:32.459284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:32.515736 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:32.520470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:32.535759 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:32.539016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:32.544107 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:32.547753 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:32.549019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:32.549982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:32.943132 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:32.954688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:32.964994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:32.968049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:32.969510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e33fecdc-e352-44b8-a333-a53d01abcfa7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.464766 Aug 29 21:35:32.970635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 88/182] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:32.977705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-42760e94-16cf-4efd-a4de-dedf21b3e833 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.546430 Aug 29 21:35:32.989859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 95/183] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:32.992994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-c22fd88f-5866-4832-b3d2-ae210e3cb182 req-b16d3680-2c1c-4363-b953-58be5b8af007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d60cc0-bd66-4d79-a1fc-c673f14f3719", "tag": "79623b1d-b179-4248-a2d5-218f0799ca95"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:33.021894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:33.024086 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:33.031540 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-c22fd88f-5866-4832-b3d2-ae210e3cb182 req-b16d3680-2c1c-4363-b953-58be5b8af007 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:33.032283 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-c22fd88f-5866-4832-b3d2-ae210e3cb182 req-b16d3680-2c1c-4363-b953-58be5b8af007 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:33.032932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-c22fd88f-5866-4832-b3d2-ae210e3cb182 req-b16d3680-2c1c-4363-b953-58be5b8af007 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:33.044945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:33.045813 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:33.046563 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:33.047737 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:33.051720 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:33.051720 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:33.054459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-c22fd88f-5866-4832-b3d2-ae210e3cb182 req-b16d3680-2c1c-4363-b953-58be5b8af007 service nova] Creating event network-changed:79623b1d-b179-4248-a2d5-218f0799ca95 for instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 on hv-cinder-85426 Aug 29 21:35:33.062662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-c22fd88f-5866-4832-b3d2-ae210e3cb182 req-b16d3680-2c1c-4363-b953-58be5b8af007 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089533 Aug 29 21:35:33.063459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 89/184] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:33.445374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:33.460710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-02dcb22f-c484-415f-9f38-2417643f05f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.478970 Aug 29 21:35:33.482497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 96/185] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:32 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:33.920455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:33.921498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:33.930477 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:33.931413 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:33.931923 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:33.932638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:33.933225 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:33.933696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:33.970537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7d7114b6-5da5-467e-930b-4bed11f705c2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/ips" status: 200 len: 147 microversion: 2.1 time: 0.058783 Aug 29 21:35:33.972361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 90/186] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:35:33 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/ips => generated 147 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:34.006139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:34.006751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:34.011047 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:34.011792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:34.015694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.016637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.017389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:34.019265 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.019933 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.020586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:34.021136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.021724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.022284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:34.023127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.023885 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.024600 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:34.283589 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:34.293259 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:34.296697 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6f0ff07a-121b-40da-80cf-c83e371d2acf tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.294514 Aug 29 21:35:34.297780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 97/187] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:34 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:34.304642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:34.306407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:34.307612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-289de631-edae-4814-aef7-daec7f1e763b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.301062 Aug 29 21:35:34.308255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 91/188] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:34 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:35:34.498152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:34.499037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:34.508900 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.509504 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.509992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:34.510696 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.511158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.511581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:34.794113 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:34.804581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d5772030-f697-4a80-8219-cdbe8061d9b5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.312589 Aug 29 21:35:34.805609 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 98/189] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:34 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:34.955099 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-5a0fe4f0-dfca-4193-8950-cdef8422bd82 req-c4489a8b-6f4d-473e-83b6-45da15b3cf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82034d8e-e8f3-430f-bef6-c41bf7a18706", "name": "network-vif-plugged", "status": "completed", "tag": "938f0e7d-9e6f-4fdc-8e6a-874e78872d6d"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:34.976044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-5a0fe4f0-dfca-4193-8950-cdef8422bd82 req-c4489a8b-6f4d-473e-83b6-45da15b3cf2b service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:34.977442 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-5a0fe4f0-dfca-4193-8950-cdef8422bd82 req-c4489a8b-6f4d-473e-83b6-45da15b3cf2b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:34.978690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-5a0fe4f0-dfca-4193-8950-cdef8422bd82 req-c4489a8b-6f4d-473e-83b6-45da15b3cf2b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.009709 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-5a0fe4f0-dfca-4193-8950-cdef8422bd82 req-c4489a8b-6f4d-473e-83b6-45da15b3cf2b service nova] Creating event network-vif-plugged:938f0e7d-9e6f-4fdc-8e6a-874e78872d6d for instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 on hv-cinder-85426 Aug 29 21:35:35.020318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-5a0fe4f0-dfca-4193-8950-cdef8422bd82 req-c4489a8b-6f4d-473e-83b6-45da15b3cf2b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073337 Aug 29 21:35:35.021902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 92/190] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:35.333238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:35.336032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:35.344437 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:35.346737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:35.365884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.367430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.370479 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.372001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.372792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.373994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.380821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.382835 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.383814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.384997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.385904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.386967 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.435544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:35.889976 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:35.896203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:35.905606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:35.907102 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:35.908262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ad48018b-e531-4235-b8cf-2796f7bf24ea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.580082 Aug 29 21:35:35.909174 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-69d7ffa1-c93d-443c-adb8-4350dd306ad8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.583806 Aug 29 21:35:35.909747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 93/191] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:35 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:35.911375 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 99/192] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:35 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:35.919037 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:35.921169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:35.930724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.931207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.931830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:35.932522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:35.932973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:35.933392 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:36.116804 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:36.132054 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0ee1a1f4-cf7a-4e4f-b06a-563101286b80 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.220341 Aug 29 21:35:36.133314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 94/193] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:35 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:36.935508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:36.937058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:36.943216 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:36.943835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:36.947558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:36.950147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.951324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.952384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:36.954145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.954692 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.956114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:36.965671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.966198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.966635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:36.967434 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:36.968535 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:36.968971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:37.040877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=12 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:37.380730 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:37.381572 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:37.390249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:37.391841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:37.393848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5cd4dd07-52e6-466e-81b7-07da74ed0df4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1314 microversion: 2.1 time: 0.455619 Aug 29 21:35:37.394070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0d0d32c5-587a-4c01-972f-07c64b18bab2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.462897 Aug 29 21:35:37.394826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 95/194] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:36 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:37.402838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "975c37e0-3981-4e41-9ab5-ed5cac352a8c"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:37.406860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 100/195] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:36 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:37.408487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:37.419407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:37.420646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:37.421682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:37.423181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:37.424289 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:37.424486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:37.425032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:37.425199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:37.441926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:37.442702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:37.443148 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:37.443859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:37.444315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:37.445411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:37.734092 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:37.751088 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-dd60025c-23d0-4669-8d62-d03a1d8fe32e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.331952 Aug 29 21:35:37.781567 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 101/196] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:37 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:38.164628 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:38.165854 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:38.172828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.173434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.174023 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:38.175056 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.175736 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.176229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:38.206090 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ec3188e1-dbbb-48a7-a0ce-85e888023300 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/ips" status: 200 len: 150 microversion: 2.1 time: 0.045140 Aug 29 21:35:38.211079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 102/197] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:35:38 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:38.250141 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e43468cc-1d94-4668-a327-c671a9662652 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853833 Aug 29 21:35:38.250745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 96/198] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:35:37 2022] POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:38.428612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:38.430208 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:38.434478 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:38.437308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:38.445547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.446753 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.447342 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:38.448397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.448626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.448902 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.449335 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:38.449716 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.450376 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:38.451583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:38.452663 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:38.453518 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.008540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:39.014168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:39.032167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:39.037760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:39.040899 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-663feece-313a-4310-831e-ac5e1256e094 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.623273 Aug 29 21:35:39.042159 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cdb8d666-bc90-48d4-8a45-295846c4d564 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1462 microversion: 2.1 time: 0.617677 Aug 29 21:35:39.055210 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 103/199] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:38 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:39.055400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 97/200] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:38 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1462 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:39.079298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-7afde973-5ea7-4213-8fda-31476a8e103a req-888b329f-e8a2-4abf-b1eb-d42adb6164ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d60cc0-bd66-4d79-a1fc-c673f14f3719", "name": "network-vif-plugged", "status": "completed", "tag": "79623b1d-b179-4248-a2d5-218f0799ca95"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:39.095103 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:39.096784 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:39.116370 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-7afde973-5ea7-4213-8fda-31476a8e103a req-888b329f-e8a2-4abf-b1eb-d42adb6164ea service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.117486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-7afde973-5ea7-4213-8fda-31476a8e103a req-888b329f-e8a2-4abf-b1eb-d42adb6164ea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.117682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.118050 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.118491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.119221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.119677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-7afde973-5ea7-4213-8fda-31476a8e103a req-888b329f-e8a2-4abf-b1eb-d42adb6164ea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.120029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.121002 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.144891 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-7afde973-5ea7-4213-8fda-31476a8e103a req-888b329f-e8a2-4abf-b1eb-d42adb6164ea service nova] Creating event network-vif-plugged:79623b1d-b179-4248-a2d5-218f0799ca95 for instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 on hv-cinder-85426 Aug 29 21:35:39.153463 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-7afde973-5ea7-4213-8fda-31476a8e103a req-888b329f-e8a2-4abf-b1eb-d42adb6164ea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095545 Aug 29 21:35:39.155089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 104/201] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:39.176540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:39.178320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:39.191837 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.193437 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.194315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.195733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.197542 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.199869 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.273241 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:35:39.424544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:39.434985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-05b435d4-ef76-4bbc-a26b-0ac90308c42c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.377876 Aug 29 21:35:39.435629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 98/202] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:39 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:39.459215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-70e983cf-4b24-42a2-aa94-81ac8c3c3ca5 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "DELETE /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 204 len: 0 microversion: 2.1 time: 0.287115 Aug 29 21:35:39.460373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 105/203] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:35:39 2022] DELETE /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:35:39.472342 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:39.473182 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:39.496463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.497331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.498085 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.499193 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.500051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.500739 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.740246 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:39.742975 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:39.751129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-934e19cb-9b2b-4582-9885-2af3e65f1bd8 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1468 microversion: 2.1 time: 0.284048 Aug 29 21:35:39.755843 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 99/204] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:39 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1468 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:39.919923 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00904f44-7dcb-43f1-adfc-58aae3724ddf"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:39.922604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:39.930051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.930540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.931016 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:39.931826 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:39.932277 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:39.932697 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:40.089261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:40.089919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:40.097699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:40.098242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:40.098693 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:40.099435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:40.099890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:40.100312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:40.263031 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:40.279482 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:40.281209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:40.282400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1210809f-75c5-4e21-8ef1-6ae03c671c3b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.197701 Aug 29 21:35:40.282965 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 100/205] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:40 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:35:40.458012 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:40.458872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:40.465840 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:40.466425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:40.467018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:40.467794 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:40.468297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:40.468785 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:40.638036 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:40.650994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6736dc03-c33e-4c48-994e-bce245dafa7d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.196894 Aug 29 21:35:40.651940 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 101/206] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:40 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:40.777965 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:40.779034 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:40.788763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:40.789255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:40.789697 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:40.790472 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:40.790895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:40.791324 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:40.965117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:40.976023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8f152638-6b4f-40e2-953b-2d13973f0ff4 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1468 microversion: 2.1 time: 0.204883 Aug 29 21:35:40.976616 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 102/207] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:40 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:41.312027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:41.312906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:41.321605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:41.322128 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:41.322594 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:41.323291 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:41.323740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:41.324159 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:41.489016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:41.497687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:41.499559 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:41.500483 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c7a97e8b-e435-4581-a112-c2f39b55af0e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.194773 Aug 29 21:35:41.500849 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 103/208] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:41 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:35:41.678232 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:41.679252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:41.690285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:41.690785 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:41.691321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:41.692051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:41.692501 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:41.692925 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:41.860100 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:41.873431 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2b962ec8-0ffc-4ccc-a709-26d893a583c4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.202290 Aug 29 21:35:41.874226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 104/209] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:41 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:42.005955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:42.006566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:42.013336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.013986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.014470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:42.015305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.015808 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.016287 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:42.163383 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:42.171939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a5c05305-b88a-4bec-86b2-0e7213075e09 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1468 microversion: 2.1 time: 0.169936 Aug 29 21:35:42.172521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 105/210] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:42 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1468 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:42.525350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:42.526218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:42.532632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.533733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.534245 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:42.537508 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.538071 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.538468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:42.687939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:42.701315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:42.702801 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:42.703966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e331236a-0810-4e17-9fdb-b2a77a6f9757 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.182842 Aug 29 21:35:42.704520 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 106/211] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:42 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:35:42.899069 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:42.899732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:42.906575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.907062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.907501 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:42.908282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:42.909322 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:42.909755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:43.103971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:43.114921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ef50b107-57ef-4cdd-ab9e-520f07547fe4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.220918 Aug 29 21:35:43.115762 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 107/212] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:42 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:43.197898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:43.198525 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:43.205730 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:43.206533 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:43.207220 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:43.208016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:43.208513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:43.208984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:43.393162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:43.403714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-678a3624-aaac-45b7-bfd7-60c5590e7ad7 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1468 microversion: 2.1 time: 0.210185 Aug 29 21:35:43.404745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 108/213] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:43 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1468 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:43.723062 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7e8d16d9-3608-4e85-be14-b542d2415a3b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.807388 Aug 29 21:35:43.723062 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 106/214] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:35:39 2022] POST /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 194 bytes in 3809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:43.734946 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:43.735723 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:43.746473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:43.747294 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:43.747981 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:43.749453 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:43.750316 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:43.751005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:43.967717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:43.982940 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:43.985277 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:43.988318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-340ef4c0-63a8-4c2c-8ea5-a676ecc74d4d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1407 microversion: 2.20 time: 0.260757 Aug 29 21:35:43.989087 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 109/215] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:43 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:35:44.147022 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:44.153673 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:44.194525 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:44.195558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:44.196253 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:44.197591 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:44.198663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:44.199612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:44.287120 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-7e76bbc2-389e-4e9f-8ee2-3a9a746db9a3 req-f8f906fa-3f3b-4af2-b668-8bea4534b556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82034d8e-e8f3-430f-bef6-c41bf7a18706", "name": "network-vif-deleted", "tag": "938f0e7d-9e6f-4fdc-8e6a-874e78872d6d"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:44.299283 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7e76bbc2-389e-4e9f-8ee2-3a9a746db9a3 req-f8f906fa-3f3b-4af2-b668-8bea4534b556 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:44.300127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7e76bbc2-389e-4e9f-8ee2-3a9a746db9a3 req-f8f906fa-3f3b-4af2-b668-8bea4534b556 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:44.300628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7e76bbc2-389e-4e9f-8ee2-3a9a746db9a3 req-f8f906fa-3f3b-4af2-b668-8bea4534b556 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:44.320821 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-7e76bbc2-389e-4e9f-8ee2-3a9a746db9a3 req-f8f906fa-3f3b-4af2-b668-8bea4534b556 service nova] Creating event network-vif-deleted:938f0e7d-9e6f-4fdc-8e6a-874e78872d6d for instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 on hv-cinder-85426 Aug 29 21:35:44.331851 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-7e76bbc2-389e-4e9f-8ee2-3a9a746db9a3 req-f8f906fa-3f3b-4af2-b668-8bea4534b556 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047166 Aug 29 21:35:44.332903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 110/216] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:35:44.420864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:44.432087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e405a915-7520-403f-9e89-8833fa7cd071 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.293741 Aug 29 21:35:44.433309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 107/217] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:44 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:44.443408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:44.445061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:44.457313 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:44.458371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:44.458958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:44.460145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:44.460996 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:44.461913 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:44.570777 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:44.581163 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0b850968-a945-43a2-9d6f-960ea6fc389b tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1426 microversion: 2.1 time: 0.145896 Aug 29 21:35:44.581758 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 111/218] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:44 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1426 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:45.018958 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:45.019549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:45.027437 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.027936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.028379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.029268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.029765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.030447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.179343 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:45.188056 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:45.190173 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:45.191577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b66d18d0-ef5b-4934-aa1c-b1e60cc5b788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1599 microversion: 2.20 time: 0.178660 Aug 29 21:35:45.192178 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 108/219] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:35:45 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:35:45.216349 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:45.217020 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:45.224016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.224494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.224925 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.225616 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.226106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.226528 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.322112 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d2d0ae9e-b58c-416c-bdbc-841905b34200 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109641 Aug 29 21:35:45.323277 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 112/220] 10.222.0.90 () {60 vars in 1316 bytes} [Mon Aug 29 21:35:45 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:35:45.464207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:45.464830 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:45.471371 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.471919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.472387 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.473119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.473640 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.474097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.606690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:45.608080 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:45.612545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:45.620896 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.621562 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.622032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.622935 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:45.623389 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:45.623945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:45.679327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:45.692387 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2fd1c7f5-7e6d-41a0-8a1d-5f7c4e5da9e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.234443 Aug 29 21:35:45.693251 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 109/221] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:45 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:45.868167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:45.882260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d8155efc-dbc4-47c3-b5ba-6c4487c86090 tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1299 microversion: 2.1 time: 0.280183 Aug 29 21:35:45.883162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 113/222] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:45 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:46.726799 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:46.727840 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:46.762787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:46.763389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:46.763927 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:46.764878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:46.765442 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:46.766004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:46.919621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:46.926656 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:46.950127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:46.953296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:46.954765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:46.961756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:46.963610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:46.964815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.041025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:47.042908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:47.043765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.044456 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lazy-loading 'fault' on Instance uuid 82034d8e-e8f3-430f-bef6-c41bf7a18706 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:35:47.057440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:47.071598 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-46b44c64-d515-4567-9978-ba84b95124ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.353576 Aug 29 21:35:47.075797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 110/223] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:46 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:47.088728 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-7d2614eb-d08e-49ed-a3c1-4a092eebf7e3 req-cb38ad84-df02-40a5-b4c4-4cb53a1bb6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d60cc0-bd66-4d79-a1fc-c673f14f3719", "tag": "79623b1d-b179-4248-a2d5-218f0799ca95"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:47.110694 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29a2a13867e7485590d34bb87b81d6f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd38d98e8f042b69c60978ea8e7742b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:47.120205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f75f63a9-9fe7-45ba-bebd-4d1fb4892d7a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 200 len: 1304 microversion: 2.1 time: 0.215461 Aug 29 21:35:47.121031 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-7d2614eb-d08e-49ed-a3c1-4a092eebf7e3 req-cb38ad84-df02-40a5-b4c4-4cb53a1bb6de service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:47.121216 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 114/224] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:46 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:47.123418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-7d2614eb-d08e-49ed-a3c1-4a092eebf7e3 req-cb38ad84-df02-40a5-b4c4-4cb53a1bb6de service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:47.124392 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-7d2614eb-d08e-49ed-a3c1-4a092eebf7e3 req-cb38ad84-df02-40a5-b4c4-4cb53a1bb6de service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.149015 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-7d2614eb-d08e-49ed-a3c1-4a092eebf7e3 req-cb38ad84-df02-40a5-b4c4-4cb53a1bb6de service nova] Creating event network-changed:79623b1d-b179-4248-a2d5-218f0799ca95 for instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 on hv-cinder-85426 Aug 29 21:35:47.158291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-7d2614eb-d08e-49ed-a3c1-4a092eebf7e3 req-cb38ad84-df02-40a5-b4c4-4cb53a1bb6de service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079713 Aug 29 21:35:47.159821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 111/225] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:47.331125 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b61a1ed1-3ab0-486b-8dcf-9d293e17b8a2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:47.338585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b61a1ed1-3ab0-486b-8dcf-9d293e17b8a2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:47.342607 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b61a1ed1-3ab0-486b-8dcf-9d293e17b8a2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:47.343131 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b61a1ed1-3ab0-486b-8dcf-9d293e17b8a2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.417343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b61a1ed1-3ab0-486b-8dcf-9d293e17b8a2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Going to try to stop instance {{(pid=127069) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:35:47.469634 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b61a1ed1-3ab0-486b-8dcf-9d293e17b8a2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action" status: 202 len: 0 microversion: 2.1 time: 0.143629 Aug 29 21:35:47.470408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 115/226] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:35:47 2022] POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:35:47.485387 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:47.487263 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:47.497091 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:47.497716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:47.498456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.499306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:47.499917 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:47.500445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:47.886132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:47.898984 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-83a02c7b-a8f3-4df4-a191-0fde5a7f0b76 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.423378 Aug 29 21:35:47.900135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 112/227] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:47 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:48.108188 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:48.109352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:48.123628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.124369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.125093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:48.126327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.128337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.129593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:48.138518 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:48.165388 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:48.168389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] [instance: 82034d8e-e8f3-430f-bef6-c41bf7a18706] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:48.182894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.183911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.184636 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:48.185831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.186439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.187164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:48.210089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] HTTP exception thrown: Instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 could not be found. Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Request method failure captured: Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 HTTP/1.1 Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTEUEiOkrxEDehNMMBvsrDDojSa6Odoffp7YCqJL7-wO74T9NBAwWBtf0o0KCycZ6xfL9JzuqYf8dglEkytrBQski5WK6oNA9D9Dh_Ymzub4QZBG9U-WiLHn7SQYYndN1kVu-JAF2n2tfZnTm_CebuyIMXIFKnC4Es3wogmx_jbQpro Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 2dd38d98e8f042b69c60978ea8e7742b Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesNegativeTest-1082131363 Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:35:48.212094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2dd38d98e8f042b69c60978ea8e7742b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2dd38d98e8f042b69c60978ea8e7742b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2dd38d98e8f042b69c60978ea8e7742b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2dd38d98e8f042b69c60978ea8e7742b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesNegativeTest-1082131363 Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 2dd38d98e8f042b69c60978ea8e7742b Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesNegativeTest-1082131363 Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesNegativeTest-1082131363-project Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 29a2a13867e7485590d34bb87b81d6f6 Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesNegativeTest-1082131363-project Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 could not be found. Aug 29 21:35:48.213528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '82034d8e-e8f3-430f-bef6-c41bf7a18706'} Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 could not be found. Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:48.214336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 could not be found. Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 could not be found. Aug 29 21:35:48.215537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:48.216717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] Returning 404 to user: Instance 82034d8e-e8f3-430f-bef6-c41bf7a18706 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:48.216717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-86c7b9d7-1e49-4c63-a623-03527c46908a tempest-VolumesNegativeTest-1082131363 tempest-VolumesNegativeTest-1082131363-project] 10.222.0.90 "GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706" status: 404 len: 111 microversion: 2.1 time: 0.056245 Aug 29 21:35:48.216717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 113/228] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:48 2022] GET /compute/v2.1/servers/82034d8e-e8f3-430f-bef6-c41bf7a18706 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:35:48.486760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:48.495530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fe1b9afa-a85e-4d01-be78-c86cabfaddaf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.394590 Aug 29 21:35:48.498538 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 116/229] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:48 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:48.927351 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:48.931468 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:48.942986 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.943876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.944735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:48.946011 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:48.946958 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:48.947515 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.161528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:49.172227 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d5389f17-a45d-432a-a5b9-9c96bbebd754 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.252473 Aug 29 21:35:49.172895 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 114/230] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:48 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:49.522226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:49.522838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:49.529991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.530559 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.531070 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.531843 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.532369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.532903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.703944 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:49.714221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9f90b36c-fe67-4164-8d48-bb1541dbd1a0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1501 microversion: 2.1 time: 0.196659 Aug 29 21:35:49.714880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 117/231] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:49 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:49.736826 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9abcdb62-2872-4a85-9812-41c0ed733043"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:49.739612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:49.746171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.746708 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.747183 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.747894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.748349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.748781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.776547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:49.784973 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] HTTP exception thrown: Cannot 'attach_volume' instance 71714c3b-cd6f-413e-a16b-e97161abd750 while it is in vm_state rescued Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Request method failure captured: Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: POST /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750/os-volume_attachments HTTP/1.1 Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 74 Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTC6fe_HCUiyXe_MK1lc6j4kjt8kNPHwscosrHkhpoGn5UfboQOWXEyGKJGIcVvo4m78_Z4Ot-7zS752D_DyN61UBRJ-8iRO94SzJpEiPqun7W4qxVpxz1d_jU8VeOqebGMVqMD4Z9tZPtW8MPOagsT3qzv8y5khHsAuWQRNXjVkIN0 Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:35:49.787516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fb0643eb366140d59f96d86259557915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fb0643eb366140d59f96d86259557915", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 39f161e61a514d94b6008bd006cda5ce Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {"volumeAttachment": {"volumeId": "9abcdb62-2872-4a85-9812-41c0ed733043"}} Aug 29 21:35:49.788956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Cannot 'attach_volume' instance 71714c3b-cd6f-413e-a16b-e97161abd750 while it is in vm_state rescued Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'server_id': '71714c3b-cd6f-413e-a16b-e97161abd750', 'body': {'volumeAttachment': {'volumeId': '9abcdb62-2872-4a85-9812-41c0ed733043'}}} Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 71714c3b-cd6f-413e-a16b-e97161abd750 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:35:49.789919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 71714c3b-cd6f-413e-a16b-e97161abd750 while it is in vm_state rescued Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:35:49.791294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:35:49.792860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:35:49.792860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:35:49.792860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 71714c3b-cd6f-413e-a16b-e97161abd750 while it is in vm_state rescued Aug 29 21:35:49.792860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:35:49.792860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Returning 409 to user: Cannot 'attach_volume' instance 71714c3b-cd6f-413e-a16b-e97161abd750 while it is in vm_state rescued {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:35:49.792860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1a1e2d29-7c5a-444f-851e-9af8298229ae tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056427 Aug 29 21:35:49.797904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:49.798974 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:49.800946 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 115/232] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:35:49 2022] POST /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:35:49.805359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.806033 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.806648 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.807491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.808030 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.808521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.894232 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-37ca66dc-09e8-4b1f-a001-e565f801dae3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750/action" status: 202 len: 0 microversion: 2.1 time: 0.100254 Aug 29 21:35:49.898027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 118/233] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:35:49 2022] POST /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:35:49.904380 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:49.904998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:49.912427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.912995 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.913432 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:49.914153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:49.914605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:49.915028 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:50.085471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:50.099016 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2d324da1-c571-4693-bab1-ad2a25f5432b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1509 microversion: 2.1 time: 0.199073 Aug 29 21:35:50.100008 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 116/234] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:49 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:50.201809 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:50.202674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:50.209922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:50.210597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:50.211543 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:50.212110 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:50.212748 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:50.213187 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:50.390490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:50.420499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e4651935-a0a2-496a-b426-ba16c2882a06 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.224231 Aug 29 21:35:50.421103 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 119/235] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:50 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:51.133879 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:51.134932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:51.138535 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:35:51.146969 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:51.148110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:51.148556 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:51.149270 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:51.149780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:51.150249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:51.316626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:51.325008 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-734deae9-b2cc-4ccf-b5c1-0186d67405dd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1509 microversion: 2.1 time: 0.198236 Aug 29 21:35:51.325700 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 117/236] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:51 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:51.443650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:51.444850 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:51.452006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:51.452272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:51.452987 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:51.453581 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:51.454052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:51.454704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:51.642191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:51.654239 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-62e4902f-684c-42aa-bfc6-e521151af509 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.214762 Aug 29 21:35:51.656560 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 120/237] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:51 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:52.352541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:52.353177 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:52.360137 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.360714 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.361187 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.361892 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.362354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.362783 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.629492 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:52.638040 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-707d6558-25d0-4e9d-ae77-15cde653b338 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1509 microversion: 2.1 time: 0.290585 Aug 29 21:35:52.638897 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 118/238] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:52 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:52.680491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:52.681534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:52.690796 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.691605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.692357 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.693304 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:52.694020 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:52.694565 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:52.877257 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:52.892804 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6bce1d50-6026-46f8-91b4-ff40d72ed31f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.216719 Aug 29 21:35:52.893873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 121/239] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:52 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:53.665079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:53.666520 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:53.676127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.677360 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.678767 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:53.680602 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.681081 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.686527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:53.889649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:53.901114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-62e99721-30bd-434d-b321-6f943b8123f5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1509 microversion: 2.1 time: 0.240008 Aug 29 21:35:53.901685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 119/240] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:53 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:53.932172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:53.933906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:53.944509 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.945562 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.946439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:53.947650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:53.948486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:53.949205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:54.141402 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:54.153556 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9dc0fe7a-47e7-4245-8c8f-00dd64c51d07 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.227568 Aug 29 21:35:54.154179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 122/241] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:53 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:54.943094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:54.943801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:54.971268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:54.971950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:54.972795 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:54.973646 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:54.974262 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:54.974729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:55.180195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:55.182336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:55.190434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:55.192838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:55.193335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:55.193831 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:55.194541 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:55.195908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:55.196602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:55.200222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0c96f27a-5916-41b1-9ec1-83c9181132e3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1509 microversion: 2.1 time: 0.273798 Aug 29 21:35:55.200771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 120/242] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:54 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:55.438308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:55.448276 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f7b0b149-7d1e-4916-8299-da62402fb46e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.274287 Aug 29 21:35:55.448929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 123/243] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:55 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:55.910010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c30ceee9-3b13-4caf-a989-1eca5836ef63 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: .version_select at 0x7f8bdf9a4160>, body: {"keypair": {"name": "tempest-keypair-62817663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYldTIOk6YEPfaqrLzoTMlrFoIyKXY6BEMO/LoZ4bn56Yj5kEh22edU0RocfUqpb1hHct4kTvGU0lGAOJNMhQQONtq1biHk5qawKmS8hX/5hsQmBKdDuisFvCgt+GgM4w=="}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:55.926979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-c30ceee9-3b13-4caf-a989-1eca5836ef63 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:55.932032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-c30ceee9-3b13-4caf-a989-1eca5836ef63 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:55.966219 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c30ceee9-3b13-4caf-a989-1eca5836ef63 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.064177 Aug 29 21:35:55.966865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 121/244] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:35:55 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:35:56.225366 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:56.226036 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:56.235115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:56.236424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:56.237061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:56.237770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:56.238457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:56.238892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:56.484611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:56.485664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:56.495266 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:56.496077 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:56.497352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:56.498380 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:56.499048 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:56.499686 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:56.560652 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:56.588753 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ce67c79f-358e-4e20-b34c-19b2bebc59da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1509 microversion: 2.1 time: 0.369398 Aug 29 21:35:56.589363 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 124/245] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:56 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1509 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:56.817771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:56.841056 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b21d2e7c-3f36-4103-8ce4-debf45f02aac tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.369849 Aug 29 21:35:56.865528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 122/246] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:56 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:35:57.619467 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:57.620666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.630958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.633478 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.634208 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.635345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.635818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.637145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.872551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:57.874555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:57.884652 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.885533 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.886289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.887952 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:57.888427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:57.889013 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:57.942412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:57.967706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2d22173d-2fce-412e-acb0-ddefcc484c99 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1515 microversion: 2.1 time: 0.353887 Aug 29 21:35:57.969438 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 125/247] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:57 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:58.328558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:58.341646 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2f69121d-5123-437a-9b38-d524e53a5ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.474664 Aug 29 21:35:58.343135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 123/248] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:57 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:58.469326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-277286693", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "377bc5c8-c6c6-472a-a33a-20e9d1f177b1"}], "security_groups": [{"name": "tempest-securitygroup--490177040"}], "key_name": "tempest-keypair-62817663", "user_data": "}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:35:58.584433 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] validate_networks() for [('377bc5c8-c6c6-472a-a33a-20e9d1f177b1', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:35:59.010697 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:35:59.011194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:35:59.011829 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:35:59.012351 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:35:59.012870 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:35:59.023572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.024055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.024492 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.025219 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.025668 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.026521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.044303 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:35:59.049408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:35:59.065237 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:35:59.068233 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:35:59.120937 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9c3c70d7-a135-496a-92b2-f0c42b9138d7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656728 Aug 29 21:35:59.122227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 126/249] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:35:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:35:59.141276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b95e1f32-21ef-4c90-834f-f4e8947f1eed tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:59.143035 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b95e1f32-21ef-4c90-834f-f4e8947f1eed tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:59.222373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b95e1f32-21ef-4c90-834f-f4e8947f1eed tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:59.230214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b95e1f32-21ef-4c90-834f-f4e8947f1eed tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1239 microversion: 2.1 time: 0.096022 Aug 29 21:35:59.230797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 124/250] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:59 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:35:59.364244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:35:59.365145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:35:59.371959 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.372366 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.372803 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.373496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:35:59.374371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:35:59.374371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:35:59.549907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:35:59.559927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cbd9d0ba-2900-48b7-92ac-e376aacd77be tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.200289 Aug 29 21:35:59.560519 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 127/251] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:35:59 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:00.253596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:00.254987 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:00.269522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:00.270349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:00.271003 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:00.272062 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:00.272614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:00.273105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:00.347005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:00.359501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-823925c8-4f93-4b02-a5c3-f407f3e430db tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1243 microversion: 2.1 time: 0.110250 Aug 29 21:36:00.361343 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 125/252] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:00 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1243 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:00.583400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:00.584032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:00.591632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:00.591951 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:00.592407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:00.593122 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:00.593580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:00.594035 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:00.771650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:00.781167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2e481ce9-659b-417d-bc22-4aed2f221337 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.201937 Aug 29 21:36:00.782806 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 128/253] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:00 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:01.238943 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-570994228", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "networks": [{"uuid": "fae3cb92-2310-4e90-b384-0c76bbfb207a"}]}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:01.308656 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] validate_networks() for [('fae3cb92-2310-4e90-b384-0c76bbfb207a', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:01.396519 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:01.397564 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:01.422669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.424692 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.425380 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:01.426152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.427819 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.428597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:01.559339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:01.570936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2d05fbf2-112e-43a5-9af9-864f969bd725 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1309 microversion: 2.1 time: 0.187146 Aug 29 21:36:01.571789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 129/254] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:01 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:01.656075 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-80721932-2da9-43da-99ea-ff5e87c72614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'create', calling method: .version_select at 0x7f8bdfce1ee0>, body: {"keypair": {"name": "tempest-keypair-66272072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuaN50LJrHojyLE+vTlAVwojDwXxvcCqc+2ZuOs7xLCy/DaAjmzfBNXLuj6u2ZzdZbBPTEKRKhiDNgMX+rK21WRyjmY6yu59ec4FBiQ6yF9G6F/+tuXfPpB4jaAGr+p4w=="}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:01.674578 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-80721932-2da9-43da-99ea-ff5e87c72614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for project fb0643eb366140d59f96d86259557915. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:01.679260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-80721932-2da9-43da-99ea-ff5e87c72614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for user 39f161e61a514d94b6008bd006cda5ce and project fb0643eb366140d59f96d86259557915. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:01.702290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-80721932-2da9-43da-99ea-ff5e87c72614 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050328 Aug 29 21:36:01.702888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 130/255] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:36:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:01.804532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:01.805145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:01.812247 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.812964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.813764 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:01.814852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:01.815482 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:01.816148 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:02.157568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:02.158239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:02.158730 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:02.159142 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:02.159824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:02.165249 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:02.175600 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-738408d4-d7ac-4fd0-844f-7f486ce783e2 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.374738 Aug 29 21:36:02.176884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:02.177051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 131/256] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:01 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:02.178006 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:02.178623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:02.179436 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:02.179916 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:02.180324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:02.202722 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Getting quotas for project f3bcb7919eee471b8dd0a728fd6255a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:02.211474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Getting quotas for user 736ad47c636d4172b1a646437ac4feec and project f3bcb7919eee471b8dd0a728fd6255a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:02.229007 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:02.236396 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:02.288170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d0993558-10ca-46c5-bc55-7391b88f3a69 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054078 Aug 29 21:36:02.296119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 126/257] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:36:02.301982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-62d92b0e-7f1c-4eb2-a038-9ef0b645fe47 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:02.302863 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-62d92b0e-7f1c-4eb2-a038-9ef0b645fe47 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:02.593880 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:02.595284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:02.602914 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:02.603622 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:02.604204 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:02.605046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:02.605648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:02.606242 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:02.638991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-62d92b0e-7f1c-4eb2-a038-9ef0b645fe47 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:02.651165 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-62d92b0e-7f1c-4eb2-a038-9ef0b645fe47 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1218 microversion: 2.1 time: 0.353873 Aug 29 21:36:02.662467 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 132/258] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:02 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1218 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:02.694862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:02.712951 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ac342119-2c7a-4144-b228-acbb99cb7990 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1297 microversion: 2.1 time: 0.123519 Aug 29 21:36:02.714317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 127/259] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:02 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:03.206578 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:03.207708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:03.221565 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.223149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.223861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.224826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.225487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.226240 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.599576 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1707901810", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60f0f1c2-7dff-4e25-9e4a-77c8e5d3f3e2"}], "security_groups": [{"name": "tempest-securitygroup--1608477145"}], "key_name": "tempest-keypair-66272072", "user_data": "}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:03.615731 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:03.629232 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-87df82b2-cdc3-4079-a619-e61eb90593c4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1724 microversion: 2.1 time: 0.431048 Aug 29 21:36:03.630046 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 133/260] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:03 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1724 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:03.683458 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:03.684851 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:03.692010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.692510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.693074 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.693658 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.694305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.694898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.718161 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:03.802530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:03.812787 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-768480e3-ea57-4ada-aa0e-81865eed6018 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1270 microversion: 2.1 time: 0.140468 Aug 29 21:36:03.814221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 134/261] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:03 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:03.825334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:03.826002 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:03.834534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.835313 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.836311 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.837375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:03.838015 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:03.838885 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:03.885775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] validate_networks() for [('60f0f1c2-7dff-4e25-9e4a-77c8e5d3f3e2', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:04.294547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:04.303738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-64729e2f-adf4-4a44-a5fe-d7ab71ab2ba1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1364 microversion: 2.1 time: 0.488058 Aug 29 21:36:04.304526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 135/262] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:03 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1364 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:04.654920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:04.655743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:04.667767 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:04.668679 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:04.669114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:04.670410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:04.671499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:04.671935 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.101819 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:05.106446 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:05.107192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:05.107792 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:05.108216 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:05.128797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.128797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.128797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.128797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.130518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.130518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.147936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:05.160626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3bd36fcd-83c2-43af-a6ca-7d7360dd9e80 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1701 microversion: 2.1 time: 0.510638 Aug 29 21:36:05.160879 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for project fb0643eb366140d59f96d86259557915. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:05.161691 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 136/263] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:04 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1701 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:05.167788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Getting quotas for user 39f161e61a514d94b6008bd006cda5ce and project fb0643eb366140d59f96d86259557915. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:05.182874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-52b6a2ad-f85a-4c20-a384-abc27ae76dae req-db91fb1f-a7cd-42d0-a542-fea154f5ad2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416273e0-c330-4270-ac80-9bfbb9ded49e", "tag": "f5bc6534-7aba-4509-9463-f64269484484"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:05.189818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:05.193838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:05.194422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-52b6a2ad-f85a-4c20-a384-abc27ae76dae req-db91fb1f-a7cd-42d0-a542-fea154f5ad2c service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.195494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-52b6a2ad-f85a-4c20-a384-abc27ae76dae req-db91fb1f-a7cd-42d0-a542-fea154f5ad2c service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.196336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-52b6a2ad-f85a-4c20-a384-abc27ae76dae req-db91fb1f-a7cd-42d0-a542-fea154f5ad2c service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.213536 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-52b6a2ad-f85a-4c20-a384-abc27ae76dae req-db91fb1f-a7cd-42d0-a542-fea154f5ad2c service nova] Creating event network-changed:f5bc6534-7aba-4509-9463-f64269484484 for instance 416273e0-c330-4270-ac80-9bfbb9ded49e on hv-cinder-85426 Aug 29 21:36:05.222306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-52b6a2ad-f85a-4c20-a384-abc27ae76dae req-db91fb1f-a7cd-42d0-a542-fea154f5ad2c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058632 Aug 29 21:36:05.222791 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 137/264] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:05.234592 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:05.236891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:05.246206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.246703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.247141 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.247842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.248295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.248742 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.280461 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e3b10cf9-39d3-4703-b5f5-c7835653b4da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.690537 Aug 29 21:36:05.281759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 128/265] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:36:05.287584 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-81090f5e-5ae2-4b41-a190-eca6a0a4137b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:05.295131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-81090f5e-5ae2-4b41-a190-eca6a0a4137b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.295911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-81090f5e-5ae2-4b41-a190-eca6a0a4137b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.296514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-81090f5e-5ae2-4b41-a190-eca6a0a4137b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.390566 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-81090f5e-5ae2-4b41-a190-eca6a0a4137b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Going to try to start instance {{(pid=127068) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:36:05.453268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-81090f5e-5ae2-4b41-a190-eca6a0a4137b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action" status: 202 len: 0 microversion: 2.1 time: 0.169871 Aug 29 21:36:05.459793 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 129/266] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:36:05 2022] POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:36:05.465854 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-877b0db7-a860-4efb-9633-7095f9ae03ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:05.466318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-877b0db7-a860-4efb-9633-7095f9ae03ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:05.706551 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:05.726454 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-824497f8-a1ad-48bf-947a-585cbc1d8198 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1276 microversion: 2.1 time: 0.501282 Aug 29 21:36:05.727643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 138/267] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:05 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1276 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:05.738461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:05.739835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:05.748291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-877b0db7-a860-4efb-9633-7095f9ae03ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:05.760166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.762228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.762916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.764042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.764740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.765577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-877b0db7-a860-4efb-9633-7095f9ae03ef tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1244 microversion: 2.1 time: 0.307812 Aug 29 21:36:05.765904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.771324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 130/268] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:05 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1244 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:05.779447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:05.785744 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:05.798094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.799034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.800928 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:05.802348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:05.803121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:05.804223 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.268675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:06.279121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c48755fe-fd52-4472-941a-32be03163926 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1364 microversion: 2.1 time: 0.549423 Aug 29 21:36:06.301351 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:06.304537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 139/269] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:05 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1364 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:06.316878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ec67eeb4-1757-4824-be63-0a985cec53b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1710 microversion: 2.1 time: 0.541912 Aug 29 21:36:06.318292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 131/270] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:05 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1710 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:06.750953 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:06.751483 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:06.759166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.760088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.761517 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.762540 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.763356 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.764127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.792755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:06.793561 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:06.802276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.803185 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.803727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.804548 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:06.805100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:06.805774 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:06.943882 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:06.957199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4eee7419-e73d-4e97-9a81-da99687e0f8e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1296 microversion: 2.1 time: 0.168382 Aug 29 21:36:06.957890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 132/271] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:06 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1296 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:07.014827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:07.023845 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fbe2a976-2ed6-4160-9ba5-e0494122a0ee tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.277077 Aug 29 21:36:07.024584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 140/272] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:06 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:07.303214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:07.305078 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:07.315353 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.317574 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.318302 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.319439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.320065 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.320661 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.345083 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:07.347980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:07.383219 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.387195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.388082 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.389031 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.390878 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.392952 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.911443 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:07.921113 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ca5772aa-780b-4c7e-a875-e35032c9b5fa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1364 microversion: 2.1 time: 0.621317 Aug 29 21:36:07.922013 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 133/273] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:07 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1364 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:07.924984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:07.934679 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dd034d57-e474-42db-81a7-d08f4c7e9839 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1710 microversion: 2.1 time: 0.597319 Aug 29 21:36:07.949813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 141/274] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:07 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1710 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:07.981131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:07.982318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:07.989842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.990343 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.990810 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:07.991679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:07.992284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:07.992719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.047928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:08.048825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:08.058062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.058833 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.059498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.059967 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.060442 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.060876 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.091365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:08.106727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9c1096af-60f4-4b06-a08b-3f7863a7a046 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1296 microversion: 2.1 time: 0.129346 Aug 29 21:36:08.107588 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 134/275] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:07 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1296 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:08.409593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:08.420381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-31f2f670-0460-4758-a3a8-a19d012595f2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.378889 Aug 29 21:36:08.425330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 142/276] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:08 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:08.752521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-e48369ce-20d3-48e3-8072-866767283d8b req-0c77b34f-08e1-436c-a017-031cb7daa4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab62c519-5b7e-4583-b621-54f18218f9e7", "tag": "7f288739-74fa-46f8-8497-5c0fc15836f2"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:08.779838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-e48369ce-20d3-48e3-8072-866767283d8b req-0c77b34f-08e1-436c-a017-031cb7daa4cb service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.781059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-e48369ce-20d3-48e3-8072-866767283d8b req-0c77b34f-08e1-436c-a017-031cb7daa4cb service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.781986 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-e48369ce-20d3-48e3-8072-866767283d8b req-0c77b34f-08e1-436c-a017-031cb7daa4cb service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.804924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-e48369ce-20d3-48e3-8072-866767283d8b req-0c77b34f-08e1-436c-a017-031cb7daa4cb service nova] Creating event network-changed:7f288739-74fa-46f8-8497-5c0fc15836f2 for instance ab62c519-5b7e-4583-b621-54f18218f9e7 on hv-cinder-85426 Aug 29 21:36:08.813933 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-e48369ce-20d3-48e3-8072-866767283d8b req-0c77b34f-08e1-436c-a017-031cb7daa4cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065434 Aug 29 21:36:08.815054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 135/277] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:08.948532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:08.948961 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:08.957388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.958030 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.958498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.959263 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.959926 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.960248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.962560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:08.963601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:08.982334 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.984052 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.984831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:08.988695 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:08.989593 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:08.990567 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:09.048931 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:09.060330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:09.495034 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:09.507907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:09.516842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5a79d728-2092-40b8-a590-f0046df03185 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1364 microversion: 2.1 time: 0.571888 Aug 29 21:36:09.518381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 143/278] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:08 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1364 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:09.530162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:09.530162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:09.531027 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-96e22db4-bd95-4fc9-9cca-015942c8137f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1714 microversion: 2.1 time: 0.563205 Aug 29 21:36:09.535628 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 136/279] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:08 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1714 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:09.549978 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:09.551827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:09.574651 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:09.575904 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:09.576896 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:09.578346 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:09.580115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:09.580700 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:09.581585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:09.582239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:09.583228 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:09.583740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:09.584602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:09.587288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.019823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:10.028197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bed9fd76-1911-406d-993a-e2c7407b42a5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1302 microversion: 2.1 time: 0.508059 Aug 29 21:36:10.028778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 144/280] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:09 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1302 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:10.209512 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:10.218860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c3507b45-5880-4f0a-92c0-185aee8a2b05 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.681756 Aug 29 21:36:10.220203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 137/281] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:09 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:10.545424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:10.546552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:10.553916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.554836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.554836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.555564 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:10.556019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:10.556485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:10.804182 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:10.812904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-87266a57-c2b8-4ad1-9ba5-4c019cafada8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1364 microversion: 2.1 time: 0.273118 Aug 29 21:36:10.814410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 145/282] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:10 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:11.053295 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:11.055770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:11.066956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.067645 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.070486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.072218 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.072819 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.074435 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.131354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-40705ec4-a1dd-496c-a2dc-efb5e531614a req-6bb86cb3-87a7-4031-9cd1-8f194cf4b788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416273e0-c330-4270-ac80-9bfbb9ded49e", "name": "network-vif-plugged", "status": "completed", "tag": "f5bc6534-7aba-4509-9463-f64269484484"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:11.152724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-40705ec4-a1dd-496c-a2dc-efb5e531614a req-6bb86cb3-87a7-4031-9cd1-8f194cf4b788 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.153392 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-40705ec4-a1dd-496c-a2dc-efb5e531614a req-6bb86cb3-87a7-4031-9cd1-8f194cf4b788 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.154290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-40705ec4-a1dd-496c-a2dc-efb5e531614a req-6bb86cb3-87a7-4031-9cd1-8f194cf4b788 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.178796 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-40705ec4-a1dd-496c-a2dc-efb5e531614a req-6bb86cb3-87a7-4031-9cd1-8f194cf4b788 service nova] Creating event network-vif-plugged:f5bc6534-7aba-4509-9463-f64269484484 for instance 416273e0-c330-4270-ac80-9bfbb9ded49e on hv-cinder-85426 Aug 29 21:36:11.187210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-40705ec4-a1dd-496c-a2dc-efb5e531614a req-6bb86cb3-87a7-4031-9cd1-8f194cf4b788 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060085 Aug 29 21:36:11.190124 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 146/283] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:11.260098 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:11.261611 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:11.273176 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.274664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.280334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.280334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.280334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.280334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.320153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:11.335044 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-062c4fae-58fc-45e0-8688-10fb5c131524 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.287735 Aug 29 21:36:11.336664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 138/284] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:11 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:11.505575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:11.519171 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0a6dddfd-ccfa-45f1-8d73-66177be83f54 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.274998 Aug 29 21:36:11.520321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 147/285] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:11 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:11.836538 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:11.837166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:11.843961 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.845147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.845875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:11.847896 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:11.849430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:11.850470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.118708 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:12.127816 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7460f60b-d14e-453f-8aaf-f46a9f4bc8ea tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1364 microversion: 2.1 time: 0.295712 Aug 29 21:36:12.128883 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 139/286] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:11 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:12.363156 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:12.363971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:12.366726 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:12.383272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:12.383272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:12.383735 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.384405 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:12.385100 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:12.385736 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.540568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:12.542312 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:12.550153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:12.550727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:12.551376 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.552161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:12.552841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:12.553352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:12.648245 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=12 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:12.854891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:12.870110 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c0f4d24f-df04-430e-aa67-a704b5f9f8b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.511462 Aug 29 21:36:12.870913 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 148/287] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:12 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:12.937658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:12.953846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ae0cce11-3026-481c-840f-8ae3b0e8393a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.417021 Aug 29 21:36:12.954756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 140/288] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:12 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:13.163531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:13.164905 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:13.181931 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.184061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.186821 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.190585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.192761 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.194019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.439010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-617607de-17c8-42a4-a502-59067d0304e2 req-dee6cb02-34e4-479b-8622-6c6140e1da4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dc22ba-7b20-4480-90d8-f249f55b1a6f", "tag": "0ce6a036-6fc5-42b4-831e-99cc480a1ca4"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:13.453267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-617607de-17c8-42a4-a502-59067d0304e2 req-dee6cb02-34e4-479b-8622-6c6140e1da4f service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.453762 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-617607de-17c8-42a4-a502-59067d0304e2 req-dee6cb02-34e4-479b-8622-6c6140e1da4f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.454401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-617607de-17c8-42a4-a502-59067d0304e2 req-dee6cb02-34e4-479b-8622-6c6140e1da4f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.467919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:13.474339 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-617607de-17c8-42a4-a502-59067d0304e2 req-dee6cb02-34e4-479b-8622-6c6140e1da4f service nova] Creating event network-changed:0ce6a036-6fc5-42b4-831e-99cc480a1ca4 for instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f on hv-cinder-85426 Aug 29 21:36:13.480200 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-617607de-17c8-42a4-a502-59067d0304e2 req-dee6cb02-34e4-479b-8622-6c6140e1da4f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046541 Aug 29 21:36:13.481249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 141/289] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:13.482550 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-325fd590-38b1-4ae7-97db-aab7e903ae8c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1364 microversion: 2.1 time: 0.323803 Aug 29 21:36:13.483584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 149/290] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:13 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:36:13.900443 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:13.901575 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:13.911718 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.912486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.912994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.914802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.915631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.916335 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.981204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:13.982318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:13.995114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.996001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.996768 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:13.997815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:13.998432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:13.999744 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.322775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:14.332156 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ab44f877-465b-448e-ac4d-5b1386ca2afc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.439341 Aug 29 21:36:14.332756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 142/291] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:13 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:14.360378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:14.368995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c175d242-8809-4b41-869b-fb23200a0a0d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.392749 Aug 29 21:36:14.369923 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 150/292] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:13 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:14.509672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:14.510881 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:14.519701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.520311 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.520825 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.521601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.522094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.522564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.726604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:14.742666 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5361170d-909a-4898-9a14-10e0c9d9282e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1553 microversion: 2.1 time: 0.239293 Aug 29 21:36:14.754217 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 143/293] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:14 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:14.763806 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:14.764952 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:14.772475 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.773343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.774053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:14.775256 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:14.776577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:14.777295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.262315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-562cdf50-ea95-46ad-a934-0edafe07d634 req-1e0aeb98-d116-4d57-b0d5-dec94f18d7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab62c519-5b7e-4583-b621-54f18218f9e7", "name": "network-vif-plugged", "status": "completed", "tag": "7f288739-74fa-46f8-8497-5c0fc15836f2"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:15.268085 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=4 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:15.274257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-562cdf50-ea95-46ad-a934-0edafe07d634 req-1e0aeb98-d116-4d57-b0d5-dec94f18d7af service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.274985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-562cdf50-ea95-46ad-a934-0edafe07d634 req-1e0aeb98-d116-4d57-b0d5-dec94f18d7af service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.275577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-562cdf50-ea95-46ad-a934-0edafe07d634 req-1e0aeb98-d116-4d57-b0d5-dec94f18d7af service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.287705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-562cdf50-ea95-46ad-a934-0edafe07d634 req-1e0aeb98-d116-4d57-b0d5-dec94f18d7af service nova] Creating event network-vif-plugged:7f288739-74fa-46f8-8497-5c0fc15836f2 for instance ab62c519-5b7e-4583-b621-54f18218f9e7 on hv-cinder-85426 Aug 29 21:36:15.293402 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-562cdf50-ea95-46ad-a934-0edafe07d634 req-1e0aeb98-d116-4d57-b0d5-dec94f18d7af service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034574 Aug 29 21:36:15.294407 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 144/294] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:15.362720 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:15.363662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:15.365488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1d934ff9-5e4e-46fe-b8f7-c1d1dbfded89 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.605546 Aug 29 21:36:15.367463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 151/295] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:36:14 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e/os-interface => generated 284 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:15.379549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:15.397876 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:15.398895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:15.400128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.400823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.404404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.405734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.406434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.408188 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.466096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.466597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.467038 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.467760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:15.481506 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:15.487343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:15.756548 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=20 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:16.187865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.196870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1d9160da-3f2e-4eb5-817b-f2f1dcb6cb2d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.846270 Aug 29 21:36:16.197574 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 145/296] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:15 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:16.221050 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:16.224788 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=100 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:16.238027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0e84b92d-bd4a-4e43-8f44-6eec21c4cf9b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.844756 Aug 29 21:36:16.240146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 152/297] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:15 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:16.858448 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-6720de75-481e-4b92-91cb-ec7f94da26bf req-9b587f91-6f1f-400d-870e-9cd62e770d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416273e0-c330-4270-ac80-9bfbb9ded49e", "tag": "f5bc6534-7aba-4509-9463-f64269484484"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:16.896409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-6720de75-481e-4b92-91cb-ec7f94da26bf req-9b587f91-6f1f-400d-870e-9cd62e770d8f service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:16.897680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-6720de75-481e-4b92-91cb-ec7f94da26bf req-9b587f91-6f1f-400d-870e-9cd62e770d8f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:16.898513 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-6720de75-481e-4b92-91cb-ec7f94da26bf req-9b587f91-6f1f-400d-870e-9cd62e770d8f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:16.936777 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-6720de75-481e-4b92-91cb-ec7f94da26bf req-9b587f91-6f1f-400d-870e-9cd62e770d8f service nova] Creating event network-changed:f5bc6534-7aba-4509-9463-f64269484484 for instance 416273e0-c330-4270-ac80-9bfbb9ded49e on hv-cinder-85426 Aug 29 21:36:16.943815 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-6720de75-481e-4b92-91cb-ec7f94da26bf req-9b587f91-6f1f-400d-870e-9cd62e770d8f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090863 Aug 29 21:36:16.945069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 146/298] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:17.227253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:17.228074 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:17.240056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.240947 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.241756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.242977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.243803 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.244591 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.286008 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:17.286610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:17.308371 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.309340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.310804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:17.312153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:17.313998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:17.314675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:18.041456 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.065943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-49413c87-392a-4a75-be64-d91429cb5a03 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.848639 Aug 29 21:36:18.067779 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 153/299] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:17 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:18.118033 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:18.130489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5f1966b2-b5ac-41a4-8ab2-9151cd9626d5 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1318 microversion: 2.1 time: 0.859372 Aug 29 21:36:18.131553 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 147/300] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:17 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1318 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:19.090351 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:19.090964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:19.111596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.115495 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.115977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.116743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.119158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.121214 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.166291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:19.167563 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:19.179201 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.180016 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.180857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.181536 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:19.182238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:19.182823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:19.591316 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:19.607124 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-90dfcf17-e645-4546-86bd-198d2d948fc7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.521240 Aug 29 21:36:19.607733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 154/301] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:19 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:19.630250 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:19.643489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b6cfead6-fdc5-4e4e-8642-0ff3a3fdc7ac tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1506 microversion: 2.1 time: 0.489886 Aug 29 21:36:19.654706 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 148/302] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:19 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1506 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:20.631468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:20.632779 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:20.641087 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.641988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.642708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.643706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:20.644144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:20.644511 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:20.952647 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:20.972608 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-936954e6-d654-4c38-a66a-850cb19e6923 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.348067 Aug 29 21:36:20.973201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 155/303] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:20 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:22.002785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:22.006259 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:22.011338 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.011980 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.012516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.013316 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:22.013918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:22.014561 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:22.268551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:22.277153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1bf23b1f-7715-40dc-b45a-476b8af1e726 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.285173 Aug 29 21:36:22.289855 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 149/304] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:21 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:23.304846 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:23.305813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:23.316702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.320885 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.321510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.322388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:23.322958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:23.323504 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:23.684158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:23.695897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b95783ea-b25f-4eaf-93b0-3ea67d65498e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.396423 Aug 29 21:36:23.706318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 156/305] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:23 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:24.141054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-b002e9bd-4f0c-444e-b9dc-b039ff60b06f req-de893525-d114-4345-9921-69b6173fd0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dc22ba-7b20-4480-90d8-f249f55b1a6f", "name": "network-vif-plugged", "status": "completed", "tag": "0ce6a036-6fc5-42b4-831e-99cc480a1ca4"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:24.156316 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b002e9bd-4f0c-444e-b9dc-b039ff60b06f req-de893525-d114-4345-9921-69b6173fd0f0 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.157115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b002e9bd-4f0c-444e-b9dc-b039ff60b06f req-de893525-d114-4345-9921-69b6173fd0f0 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.157725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b002e9bd-4f0c-444e-b9dc-b039ff60b06f req-de893525-d114-4345-9921-69b6173fd0f0 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.174074 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-b002e9bd-4f0c-444e-b9dc-b039ff60b06f req-de893525-d114-4345-9921-69b6173fd0f0 service nova] Creating event network-vif-plugged:0ce6a036-6fc5-42b4-831e-99cc480a1ca4 for instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f on hv-cinder-85426 Aug 29 21:36:24.184854 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-b002e9bd-4f0c-444e-b9dc-b039ff60b06f req-de893525-d114-4345-9921-69b6173fd0f0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047758 Aug 29 21:36:24.186090 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 150/306] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:24.730484 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:24.732845 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:24.772429 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.777599 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.780234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:24.785340 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:24.786048 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:24.788931 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:25.216115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:25.231178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a859973a-8000-4d0f-b176-912ab525be56 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.506510 Aug 29 21:36:25.232279 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 157/307] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:24 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:26.263149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:26.263944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:26.274477 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:26.275162 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:26.275616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.276339 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:26.279116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:26.279901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:26.757352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:26.767528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5ed3e117-37f6-4047-bc8f-0cf0e6b7a454 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1370 microversion: 2.1 time: 0.509548 Aug 29 21:36:26.768123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 151/308] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:26 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1370 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:27.793048 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:27.793672 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:27.811367 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.815473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.816275 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:27.817264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:27.818371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:27.819043 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.379932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:28.392072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3b965ccb-15a7-4276-ac41-69a01ba6f2bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1564 microversion: 2.1 time: 0.603230 Aug 29 21:36:28.396605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 158/309] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:27 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1564 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:28.430963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:28.432788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:28.467547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.469127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.470289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:28.472964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:28.474368 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:28.475616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:29.135486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6e88e3e9-150a-4ef4-b627-eb45fcdc4f3e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.712914 Aug 29 21:36:29.136742 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 152/310] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:36:28 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-interface => generated 284 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:31.436036 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3418f4b2-d073-4b5b-aa63-3de84131fd6b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Action: 'create', calling method: .version_select at 0x7f8bdfbb9f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1756897221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFogdyo51xc1GEdJf3YySi8uQWSs7cqEDfc1lozc8QB5D3BEs1REydx7Z25VQSdfYC7RmVZwWgLj1B9NMh3Ev67jbHFd55sGTafuYvV585A/L0IjHXW9qHki2Gos1L0cJg=="}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:31.478351 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-3418f4b2-d073-4b5b-aa63-3de84131fd6b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Getting quotas for project 69d7f124802b450eae69db4d42b62d83. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:31.486836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-3418f4b2-d073-4b5b-aa63-3de84131fd6b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Getting quotas for user 3376818708e443928951fd5f517c9d83 and project 69d7f124802b450eae69db4d42b62d83. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:31.538096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3418f4b2-d073-4b5b-aa63-3de84131fd6b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.515135 Aug 29 21:36:31.539443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 159/311] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:36:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:31.857972 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-32325282-d9b8-4a9b-81be-0df0359a50e6 req-e9eee3ad-c413-47e5-ae39-7c896bbfb7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dc22ba-7b20-4480-90d8-f249f55b1a6f", "tag": "0ce6a036-6fc5-42b4-831e-99cc480a1ca4"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:31.877950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-32325282-d9b8-4a9b-81be-0df0359a50e6 req-e9eee3ad-c413-47e5-ae39-7c896bbfb7c4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:31.879011 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-32325282-d9b8-4a9b-81be-0df0359a50e6 req-e9eee3ad-c413-47e5-ae39-7c896bbfb7c4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:31.879698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-32325282-d9b8-4a9b-81be-0df0359a50e6 req-e9eee3ad-c413-47e5-ae39-7c896bbfb7c4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:31.893438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-32325282-d9b8-4a9b-81be-0df0359a50e6 req-e9eee3ad-c413-47e5-ae39-7c896bbfb7c4 service nova] Creating event network-changed:0ce6a036-6fc5-42b4-831e-99cc480a1ca4 for instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f on hv-cinder-85426 Aug 29 21:36:31.900924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-32325282-d9b8-4a9b-81be-0df0359a50e6 req-e9eee3ad-c413-47e5-ae39-7c896bbfb7c4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047288 Aug 29 21:36:31.903024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 153/312] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:39.689042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcc4e5fe-8307-4c88-a017-ea7d7de2940f", "device": "/dev/sdb"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:39.693309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:39.695901 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=37 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:39.722921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.723758 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.724273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:39.725062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:39.725595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:39.726148 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:40.149301 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-82a7c676-c23c-4e7e-a0ae-9778551e695d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "POST /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478974 Aug 29 21:36:40.157118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 160/313] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:36:39 2022] POST /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:36:43.064955 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:43.066562 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:43.082790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=17 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:43.084690 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=82 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:43.092105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.094125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.094797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.095744 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:43.096407 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:43.097078 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:43.137210 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a4123767-c726-4de6-a415-0c01a75582ed tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/ips" status: 200 len: 151 microversion: 2.20 time: 0.091051 Aug 29 21:36:43.138120 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 154/314] 10.222.0.90 () {60 vars in 1289 bytes} [Mon Aug 29 21:36:43 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:36:46.830728 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=4 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:46.841055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:46.857372 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:46.860950 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:36:46.870572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.871881 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.872921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.876429 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:46.877530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:46.878246 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:46.908240 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lazy-loading 'flavor' on Instance uuid 28d60cc0-bd66-4d79-a1fc-c673f14f3719 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:36:50.650519 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e865b05c-dcc7-4f47-a521-b85f802536f9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/action" status: 202 len: 0 microversion: 2.20 time: 3.821089 Aug 29 21:36:50.653240 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 161/315] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 21:36:46 2022] POST /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/action => generated 0 bytes in 3825 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:36:50.660710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:50.662106 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:50.674694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.675604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.676281 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.677219 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:50.677941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:50.678974 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:50.849206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:50.862878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:50.865620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:50.867832 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cf3504d4-f892-472f-a936-67de333b9177 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.211475 Aug 29 21:36:50.877877 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 155/316] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:50 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:51.099176 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b0c43c80-7dbb-499d-9501-9f5f173f3f07 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Action: 'create', calling method: .version_select at 0x7f8bdf9cd160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2078622867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1rMvVH0iGpOFdRr6Up4/El54MDg3i/ez1pcaYOyp/gnauy8Z226UTYQbejwEZhPuVPo8XdNMrq8i1MXEXI2jaFoRrTIJIugoh3nqUUWvJHNj6ycivMJKwXHfKk4tKKtg=="}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:51.117406 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-b0c43c80-7dbb-499d-9501-9f5f173f3f07 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Getting quotas for project df74318c1e404179bbb8533b5909deb8. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:51.122174 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-b0c43c80-7dbb-499d-9501-9f5f173f3f07 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Getting quotas for user fdba2832a619433eb7e607bb8bf45c59 and project df74318c1e404179bbb8533b5909deb8. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:51.149035 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b0c43c80-7dbb-499d-9501-9f5f173f3f07 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055008 Aug 29 21:36:51.149936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 162/317] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:36:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:36:51.272827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-912467763", "imageRef": "c6d8d0f4-0cc0-42e7-871b-e5a0659f03ee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2078622867", "networks": [{"uuid": "0fbd7cbf-4dcc-414e-8607-2e3745c83a9f"}]}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:51.335287 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] validate_networks() for [('0fbd7cbf-4dcc-414e-8607-2e3745c83a9f', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:51.776340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:36:51.776340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:36:51.777452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:36:51.777452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:36:51.777631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:36:51.790680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:51.791657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:51.792413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:51.793444 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:51.794436 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:51.795762 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:51.818145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Getting quotas for project df74318c1e404179bbb8533b5909deb8. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:36:51.827969 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Getting quotas for user fdba2832a619433eb7e607bb8bf45c59 and project df74318c1e404179bbb8533b5909deb8. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:36:51.847308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:36:51.850456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6d8d0f4-0cc0-42e7-871b-e5a0659f03ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:36:51.895606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:51.896806 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:51.907168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:51.907631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:51.908073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:51.910307 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2d52789c-f1d9-4c9f-948a-00396181c4d8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642452 Aug 29 21:36:51.910509 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:51.910926 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:51.911095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 156/318] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:36:51.911361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:51.924021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c5060092-e28b-4bed-992c-fbc1c02d78b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:51.924682 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c5060092-e28b-4bed-992c-fbc1c02d78b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:52.009918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c5060092-e28b-4bed-992c-fbc1c02d78b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.024160 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c5060092-e28b-4bed-992c-fbc1c02d78b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1258 microversion: 2.1 time: 0.105417 Aug 29 21:36:52.025076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 157/319] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:51 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1258 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:52.087614 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.098012 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.099596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:52.101089 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5096ca09-3dad-4265-919c-fbeea7cdb492 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.212381 Aug 29 21:36:52.101643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 163/320] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:51 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:53.046947 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:53.047564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:53.054290 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.054790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.055268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.055998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.056524 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.057001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.125891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:53.126474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:53.133134 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.133337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.133619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.134075 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.134912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:53.135448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:53.135928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:53.141918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a7e94e83-156b-48ab-a639-4c8aaab4503a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1310 microversion: 2.1 time: 0.099626 Aug 29 21:36:53.142733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 158/321] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:53 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:53.295904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.304775 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.306296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:53.307593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7b172eae-768c-4a89-8dba-bf9268c48bea tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.186816 Aug 29 21:36:53.308191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 164/322] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:53 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:36:54.164297 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:54.164884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:54.171864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.172349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.172778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.173460 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.173944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.174365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.242504 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.250959 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8f1ee350-b481-412f-a728-ebf4b64c8bef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1310 microversion: 2.1 time: 0.090567 Aug 29 21:36:54.251527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 159/323] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:54 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:54.330316 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:54.330937 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:54.337849 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.338335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.338775 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.339492 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:54.339943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:54.340375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:54.500576 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.508933 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.510401 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:54.511544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-36f64976-ea17-4792-af79-a86ac6cf7fd8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.185317 Aug 29 21:36:54.512104 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 165/324] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:54 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:55.271929 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:55.272470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:55.279872 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.280366 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.280919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.281597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.282090 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.282515 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.351238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:55.360372 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cbb4ef94-09d9-4a2e-8351-fa1ed641defa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1310 microversion: 2.1 time: 0.092421 Aug 29 21:36:55.361019 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 160/325] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:55 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:55.534962 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:55.535734 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:55.543443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.544010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.544462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.545724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:55.546043 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:55.546561 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:55.699957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:55.709059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:55.710910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:55.712109 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c4720d74-2b7d-45f9-ad8c-950ff7e90de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.181064 Aug 29 21:36:55.712678 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 166/326] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:55 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:56.382821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:56.383431 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:56.390308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.390798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.391236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.391940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.392397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.392835 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.458507 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.467225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4cde2a74-0d6f-41f2-a2d1-40ecb004b05a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1310 microversion: 2.1 time: 0.087712 Aug 29 21:36:56.467803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 161/327] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:56 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:56.736549 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:56.738191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:56.745930 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.746677 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.747280 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.748754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:56.750044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:56.750608 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:56.941713 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.950710 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.954084 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:56.955814 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c442b9c1-4590-47f9-b642-f4dae5a9e05c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.223988 Aug 29 21:36:56.956459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 167/328] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:56 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:57.491484 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:57.492894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:57.518995 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.519133 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.519527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.520518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:57.521097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:57.521650 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:57.834091 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:57.845365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-539a2dd9-5189-4313-9bef-117f53445a06 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.359491 Aug 29 21:36:57.846271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 162/329] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:57 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:57.980693 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:57.984729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:58.008470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.009250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.010024 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.011540 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.012589 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.013911 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.239242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:58.259634 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:58.262319 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:58.271318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8939026d-135c-43bc-90c1-381aca0981c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.294571 Aug 29 21:36:58.271897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 168/330] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:57 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:36:58.868618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:58.869451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:58.877685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.878341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.878844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:58.879846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:58.880320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:58.880971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.052973 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.062062 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-222fdb50-2d6a-4945-9c79-2ec30caff056 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.198410 Aug 29 21:36:59.062787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 163/331] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:36:58 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:36:59.297570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:36:59.298862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:36:59.319076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:59.319076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:59.319076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.319076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:36:59.319660 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:36:59.319660 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:36:59.355452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1060135516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1756897221", "security_groups": [{"name": "tempest-secgroup-smoke-1728009927"}], "networks": [{"uuid": "6c56c86d-1fa1-40db-82fd-8bb0148f0ecd"}], "block_device_mapping_v2": [{"uuid": "a2727f08-d173-41f1-b7c4-dfc6d348190e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:36:59.531610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] validate_networks() for [('6c56c86d-1fa1-40db-82fd-8bb0148f0ecd', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:36:59.540129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.549362 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.551258 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:36:59.552592 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dbf20b8c-6c8e-4c2b-a33c-bb8e9b93168d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.261780 Aug 29 21:36:59.553422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 169/332] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:36:59 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:00.004885 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:37:00.005679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:37:00.006446 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:37:00.007122 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:37:00.007635 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:37:00.018872 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.019358 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.019804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.020534 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.021190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.021861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.042655 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Getting quotas for project 69d7f124802b450eae69db4d42b62d83. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:37:00.047519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Getting quotas for user 3376818708e443928951fd5f517c9d83 and project 69d7f124802b450eae69db4d42b62d83. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:37:00.082618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:00.083510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:00.090070 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.090557 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.090988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.092351 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.093024 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.093461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.134709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:37:00.136846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2727f08-d173-41f1-b7c4-dfc6d348190e',volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:37:00.335406 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.355466 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fc4a7dab-62f1-426c-8265-6a4a02a21993 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.276604 Aug 29 21:37:00.356066 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 170/333] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:00 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:00.392794 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6eaf0689-884f-49fc-b059-29ac6945874c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.041251 Aug 29 21:37:00.393486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 164/334] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:36:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:37:00.408188 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5d4fd210-64fe-4d6b-bf27-d38857c1c73d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:00.408833 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5d4fd210-64fe-4d6b-bf27-d38857c1c73d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:00.528167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5d4fd210-64fe-4d6b-bf27-d38857c1c73d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.542808 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5d4fd210-64fe-4d6b-bf27-d38857c1c73d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1089 microversion: 2.1 time: 0.141473 Aug 29 21:37:00.554198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 171/335] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:00 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1089 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:00.579663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:00.580283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:00.596273 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.596762 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.597278 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.598199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:00.598623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:00.604716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:00.835849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.856990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.863750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:00.865973 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e0ba0fb2-584d-4caf-8c0a-96dcf1879f14 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.290911 Aug 29 21:37:00.866523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 165/336] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:00 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:01.379812 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:01.380515 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:01.388612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.389092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.390332 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.390444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.390979 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.391321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.575034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:01.576829 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:01.582707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:01.592222 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2b8b5ed4-e9f9-46b4-bad0-b9d57df51fa7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.215778 Aug 29 21:37:01.592852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 172/337] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:01 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:01.606115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.606115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.606115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.606115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.606754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.606754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.706768 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:01.719497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1a9814ac-828d-47fa-ba5b-cbaff2b3dca9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1139 microversion: 2.1 time: 0.148052 Aug 29 21:37:01.720355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 166/338] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:01 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1139 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:01.898195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:01.899810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:01.914860 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.916297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.917345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:01.921153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:01.922343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:01.923394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.360128 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.370270 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.371807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.374164 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-50a4ae70-44a4-4fa5-b6dc-23d856075dac tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.487571 Aug 29 21:37:02.374789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 173/339] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:01 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:02.620028 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:02.620709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:02.630360 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.630848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.631477 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.632179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.632629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.633051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.746438 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:02.747248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:02.757119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.757614 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.758076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.758787 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:02.759244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:02.759702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:02.781941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.789924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-99e8c21c-dd98-49f3-a5a2-fe349f094e28 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.177304 Aug 29 21:37:02.790818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 167/340] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:02 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:02.829398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:02.838608 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-65c3ccc2-354c-475c-970f-1fe91c0de66a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1139 microversion: 2.1 time: 0.096479 Aug 29 21:37:02.839527 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 174/341] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:02 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:03.398709 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:03.399388 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:03.408680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.409227 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.409674 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.410463 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.410946 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.411413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.620558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:03.631794 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:03.633688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:03.639356 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f499f931-e569-41d3-ace7-3a908bbc1912 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.240913 Aug 29 21:37:03.642243 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 168/342] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:03 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:03.813053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:03.813685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:03.821549 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.821829 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.822270 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.823057 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.823646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.824001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.873233 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:03.874634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:03.875922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:03.891236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.892164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.892838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.893857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:03.895491 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:03.896992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:03.993401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.005960 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-78aa1678-b923-409a-972e-716de485bb33 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1139 microversion: 2.1 time: 0.143549 Aug 29 21:37:04.008787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 169/343] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:03 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1139 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:04.069189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.081336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-721580f2-7d9d-4ce4-9401-b37f57deeda7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.273179 Aug 29 21:37:04.082531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 175/344] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:03 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:04.660614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:04.661152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:04.667800 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.668280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.668773 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:04.669558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:04.670582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:04.670785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:04.840158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.852201 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.853801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:04.855277 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-602c226f-c7cb-465a-81fa-d092afc082f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.198773 Aug 29 21:37:04.855896 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 170/345] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:04 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:05.031278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:05.032052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:05.046757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.047516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.048142 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.049273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.049922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.050508 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.116271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:05.116886 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:05.132089 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:05.137236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.137760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.142350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.143110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.145212 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.148815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1f23bdec-6ced-4d45-aca8-0a1c0d7af5f7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1139 microversion: 2.1 time: 0.122253 Aug 29 21:37:05.149167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.150131 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 176/346] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:05 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1139 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:05.314423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:05.323433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e9cf9b37-a934-4d3a-9b4f-041d5f159cfb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.211240 Aug 29 21:37:05.324021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 171/347] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:05 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:05.884838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:05.886154 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:05.895159 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.895679 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.896221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:05.897033 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:05.897679 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:05.898571 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.117247 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.126530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.127993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.129192 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3e83abb5-8f07-434a-93fa-6f231d08fef2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.248946 Aug 29 21:37:06.129757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 177/348] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:05 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:06.180661 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:06.181271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:06.199869 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.200704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.201144 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.201899 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.202533 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.203123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.306569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.315150 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d85f072e-5594-4f1a-9704-a95272db8ef7 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1139 microversion: 2.1 time: 0.144394 Aug 29 21:37:06.315734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 172/349] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:06 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1139 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:06.347044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:06.347967 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:06.374463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.375594 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.376649 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.379252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:06.380696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:06.381766 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:06.546183 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:06.554542 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1fe11146-ffac-4c2c-befb-34ec058f940c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.211709 Aug 29 21:37:06.555123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 178/350] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:06 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:07.029390 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:07.030964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:07.037326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.038014 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.038576 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.040018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.040597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.041135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.075569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:07.158982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:07.160626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:07.169685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.171704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.172155 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.172963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.173587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.174037 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.187305 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lazy-loading 'services' on Instance uuid ab62c519-5b7e-4583-b621-54f18218f9e7 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:07.337579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a52e2af3-b954-4ea2-bdec-3ec9b19d107f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7/os-volume_attachments/fcc4e5fe-8307-4c88-a017-ea7d7de2940f" status: 202 len: 0 microversion: 2.1 time: 0.312569 Aug 29 21:37:07.343508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 173/351] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:37:07 2022] DELETE /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7/os-volume_attachments/fcc4e5fe-8307-4c88-a017-ea7d7de2940f => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:37:07.349944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:07.350664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:07.358464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.359229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.359846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.360755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.361438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.362643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.374975 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.386575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.388853 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.389502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-97481234-9642-4f9f-909b-3e22d507d230 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.235586 Aug 29 21:37:07.393858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 179/352] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:07 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:07.484785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.493404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7bc77364-3985-4a7b-9c17-a8cf4996e26c tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1139 microversion: 2.1 time: 0.147954 Aug 29 21:37:07.494071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 174/353] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:07 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1139 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:07.576167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:07.576890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:07.587938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.587938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.588494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.589230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:07.589823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:07.590340 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:07.736747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:07.744797 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-68958e7d-f694-45f1-9c9c-0ae6b2156a12 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.172618 Aug 29 21:37:07.745371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 180/354] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:07 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:08.415246 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:08.416488 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:08.424308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.424805 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.425545 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.426269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.426730 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.427159 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.519725 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:08.520339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:08.527104 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.527590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.528023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.528756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.529207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.529661 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.638746 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.646969 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-96ad4a1a-d73a-4bc1-a3bd-67fad1ceccaa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1131 microversion: 2.1 time: 0.131240 Aug 29 21:37:08.647737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 181/355] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:08 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1131 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:08.750752 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.760362 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.763196 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:08.764929 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0551a0de-96a3-4662-b141-5fe2c7664ada tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.353751 Aug 29 21:37:08.766187 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 175/356] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:08 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:08.785704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:08.786377 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:08.795582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.796292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.796836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:08.797904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:08.799181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:08.800135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.033725 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:09.044129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0573b036-c88a-4ad9-968e-bbf986034fd7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.274596 Aug 29 21:37:09.045012 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 182/357] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:08 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:09.266945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-1c0427ba-e2e7-492e-a943-3fe44ce48340 req-3799327b-e6ee-4632-a86d-675028bc9d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05755de8-1f0b-44f4-b4b5-028155749387", "tag": "6b29b603-5e32-403d-b02a-7c8b33c0dc37"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:09.277596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-1c0427ba-e2e7-492e-a943-3fe44ce48340 req-3799327b-e6ee-4632-a86d-675028bc9d8e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.278230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-1c0427ba-e2e7-492e-a943-3fe44ce48340 req-3799327b-e6ee-4632-a86d-675028bc9d8e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.278784 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-1c0427ba-e2e7-492e-a943-3fe44ce48340 req-3799327b-e6ee-4632-a86d-675028bc9d8e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.292451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-1c0427ba-e2e7-492e-a943-3fe44ce48340 req-3799327b-e6ee-4632-a86d-675028bc9d8e service nova] Creating event network-changed:6b29b603-5e32-403d-b02a-7c8b33c0dc37 for instance 05755de8-1f0b-44f4-b4b5-028155749387 on hv-cinder-85426 Aug 29 21:37:09.299206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-1c0427ba-e2e7-492e-a943-3fe44ce48340 req-3799327b-e6ee-4632-a86d-675028bc9d8e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035721 Aug 29 21:37:09.299840 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 176/358] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:09.588464 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:09.589093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:09.596474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.596989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.597426 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.598155 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.598605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.599028 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.628232 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:37:09.671164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:09.671874 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:09.679370 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.680048 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.680587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.681434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.682010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.682505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.733358 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0d55d114-339f-4f5b-81f5-8543fa437390 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 204 len: 0 microversion: 2.1 time: 0.148419 Aug 29 21:37:09.734070 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 183/359] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:37:09 2022] DELETE /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:37:09.748924 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:09.749725 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:09.756199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.756677 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.757023 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:09.757233 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.757820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.758269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.758690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.769821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-654de852-2ec5-4fab-950c-16ac44c34f07 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1187 microversion: 2.1 time: 0.103861 Aug 29 21:37:09.770467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 177/360] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:09 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:09.796511 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:09.797260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:09.804716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.805294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.805826 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:09.806605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:09.807213 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:09.807662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:10.005631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:10.015197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-47072b8e-8600-40cf-95bf-2a0711d7843b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1512 microversion: 2.1 time: 0.274554 Aug 29 21:37:10.016079 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 184/361] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:09 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:10.030114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=4 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:10.036112 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:10.046519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:10.046519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:10.047559 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4f07388d-bcba-405c-bf4d-2afc561940fa tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.255675 Aug 29 21:37:10.048131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 178/362] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:09 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:10.069197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:10.069841 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:10.076989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:10.077470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:10.077944 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:10.078635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:10.079088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:10.079512 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:10.227571 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:10.236762 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6b520718-64f0-4c31-a92d-be40265bb193 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.171538 Aug 29 21:37:10.237327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 185/363] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:10 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:10.791756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:10.792377 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:10.794512 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=14 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:10.800353 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:10.800835 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:10.801286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:10.802012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:10.802471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:10.802902 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:10.870839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:10.878666 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e68d182a-3e5f-4c19-a963-ceaa5e6cc042 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1195 microversion: 2.1 time: 0.090858 Aug 29 21:37:10.879232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 179/364] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:10 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1195 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:11.037539 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:11.038206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:11.040168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:11.046905 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.047381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.047815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.048507 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.048960 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.049382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.072058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:11.072764 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:11.079989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.080540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.081044 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.081755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.082244 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.082675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.273858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.282478 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f0028f2f-2aac-4623-8d5a-ef9863fbef08 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1512 microversion: 2.1 time: 0.248729 Aug 29 21:37:11.283062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 186/365] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:11 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:11.287132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.288129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:11.288733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:11.296817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.297502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.297972 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.298393 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.298675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.299126 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.299546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.300866 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.302187 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ad89e21b-e934-4a4a-9113-56c24d5e6542 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.234393 Aug 29 21:37:11.303964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 180/366] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:11 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:11.444938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.454319 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e882895e-3117-4eb9-b6b3-b5537730c7a9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.169862 Aug 29 21:37:11.454910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 187/367] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:11 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:11.899876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:11.900671 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:11.908215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.908797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.909545 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.910380 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:11.910839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:11.911317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:11.982621 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:11.990683 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7730f703-52a2-462c-8a48-5cf7a3b39ed2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1205 microversion: 2.1 time: 0.094879 Aug 29 21:37:11.991570 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 181/368] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:11 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:12.308387 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:12.308999 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:12.316306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.316788 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.317239 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.317944 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.318552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.318915 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.330985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:12.331906 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:12.340773 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.341739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.342326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.342918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.343376 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.343984 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.638211 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.645865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-59fb7bc2-ef73-48e2-8638-a93cefd09fe1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1512 microversion: 2.1 time: 0.341649 Aug 29 21:37:12.646732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 188/369] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:12 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:12.651487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:12.652319 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:12.659037 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.659655 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.660263 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.660962 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:12.661412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:12.661954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:12.667274 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.678209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.679937 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.681285 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-69a1dccd-38f9-462f-9813-ee76a668514b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.354908 Aug 29 21:37:12.681870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 182/370] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:12 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:12.887840 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:12.895693 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7114369d-4f53-438b-b25b-ea009e06c35c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.247785 Aug 29 21:37:12.896267 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 189/371] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:12 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:13.014612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:13.015485 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:13.022434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.023084 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.023631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:13.024443 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.025033 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.025571 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:13.173614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:13.182145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e4018fbb-a385-4516-afbe-755976880838 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1273 microversion: 2.1 time: 0.171406 Aug 29 21:37:13.182729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 183/372] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:13 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:13.669912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:13.670657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:13.677803 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.678290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.678718 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:13.679413 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.679890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.680345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:13.684875 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:13.705363 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:13.706018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:13.707946 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:13.722384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.722801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.723119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:13.723796 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:13.724254 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:13.724680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.012837 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:14.036063 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8cd9dbe6-0df5-49d9-a186-7e0f35c2ccb6 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1512 microversion: 2.1 time: 0.370587 Aug 29 21:37:14.038355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 190/373] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:13 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:14.047932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:14.049654 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:14.059034 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:14.061726 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:14.062358 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.063393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:14.064617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:14.065320 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.222529 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:14.231823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:14.233445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:14.234676 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-23af8a17-9311-4dee-9a9f-f30570aa4e79 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.533282 Aug 29 21:37:14.235435 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 184/374] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:13 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:14.253297 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:14.254378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:14.260783 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:14.261316 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:14.261770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.262623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:14.263200 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:14.263686 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.448713 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:14.457069 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1c1a0809-f6c8-4adb-a395-4f52587628b3 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.416041 Aug 29 21:37:14.469905 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 191/375] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:14 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:14.639057 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:14.647714 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e2a5c16f-3dd5-418c-8457-0410ac151046 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.400039 Aug 29 21:37:14.648337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 185/376] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:14 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:14.719570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-761b8777-d330-41c3-879c-7ac209dfc623 req-ae89aa9a-7b9b-4f21-b708-af55df90db25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab62c519-5b7e-4583-b621-54f18218f9e7", "name": "network-vif-deleted", "tag": "7f288739-74fa-46f8-8497-5c0fc15836f2"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:14.736334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-761b8777-d330-41c3-879c-7ac209dfc623 req-ae89aa9a-7b9b-4f21-b708-af55df90db25 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:14.736935 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-761b8777-d330-41c3-879c-7ac209dfc623 req-ae89aa9a-7b9b-4f21-b708-af55df90db25 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:14.738095 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-761b8777-d330-41c3-879c-7ac209dfc623 req-ae89aa9a-7b9b-4f21-b708-af55df90db25 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:14.757593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-761b8777-d330-41c3-879c-7ac209dfc623 req-ae89aa9a-7b9b-4f21-b708-af55df90db25 service nova] Creating event network-vif-deleted:7f288739-74fa-46f8-8497-5c0fc15836f2 for instance ab62c519-5b7e-4583-b621-54f18218f9e7 on hv-cinder-85426 Aug 29 21:37:14.767699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-761b8777-d330-41c3-879c-7ac209dfc623 req-ae89aa9a-7b9b-4f21-b708-af55df90db25 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054909 Aug 29 21:37:14.768572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 192/377] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:15.068366 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:15.068997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:15.080105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.081682 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.082828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.083939 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.084832 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.085509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.130333 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.131084 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.131823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.132595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lazy-loading 'fault' on Instance uuid ab62c519-5b7e-4583-b621-54f18218f9e7 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:15.217411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.225582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7b9e824c-e3a6-43f1-9c49-920ff7230840 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 200 len: 1308 microversion: 2.1 time: 0.168216 Aug 29 21:37:15.239823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 186/378] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:15 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:15.269928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:15.271216 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:15.283293 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.284201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.285001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.286280 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.287249 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.287899 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.474579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.482234 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:15.483547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:15.484780 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.486901 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.487568 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3ea89524-0fd7-4118-9ab0-72067ad05652 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1744 microversion: 2.20 time: 0.228290 Aug 29 21:37:15.490503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.491282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.491974 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.492940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.493643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.494318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.502251 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 193/379] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:15 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1744 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:15.660738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-668158f3-e219-4c6e-96c6-b2f59da36051 req-fe1053f6-1acc-461f-98cb-a05233e0a0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05755de8-1f0b-44f4-b4b5-028155749387", "name": "network-vif-plugged", "status": "completed", "tag": "6b29b603-5e32-403d-b02a-7c8b33c0dc37"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:15.678279 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-668158f3-e219-4c6e-96c6-b2f59da36051 req-fe1053f6-1acc-461f-98cb-a05233e0a0cb service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.678985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-668158f3-e219-4c6e-96c6-b2f59da36051 req-fe1053f6-1acc-461f-98cb-a05233e0a0cb service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.679433 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-668158f3-e219-4c6e-96c6-b2f59da36051 req-fe1053f6-1acc-461f-98cb-a05233e0a0cb service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.687682 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:15.692415 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-668158f3-e219-4c6e-96c6-b2f59da36051 req-fe1053f6-1acc-461f-98cb-a05233e0a0cb service nova] Creating event network-vif-plugged:6b29b603-5e32-403d-b02a-7c8b33c0dc37 for instance 05755de8-1f0b-44f4-b4b5-028155749387 on hv-cinder-85426 Aug 29 21:37:15.699206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-668158f3-e219-4c6e-96c6-b2f59da36051 req-fe1053f6-1acc-461f-98cb-a05233e0a0cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049963 Aug 29 21:37:15.700851 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 194/380] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:15.707798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:15.708103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d1237d4d-7ceb-4d31-860f-017387d49f3d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.229640 Aug 29 21:37:15.709421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 187/381] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:15 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:15.722078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:15.722078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.722078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.722078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:15.722823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:15.722823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:15.722823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.034695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.046452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-63819946-0bf2-46b9-9f63-3368e7d815b4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.343285 Aug 29 21:37:16.047139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 195/382] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:15 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:16.248200 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:16.249003 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ab62c519-5b7e-4583-b621-54f18218f9e7] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:16.255745 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.256235 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.256671 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.257369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.257855 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.258284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.272612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] HTTP exception thrown: Instance ab62c519-5b7e-4583-b621-54f18218f9e7 could not be found. Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Request method failure captured: Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 HTTP/1.1 Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTE9kqqhdRojI6DJiohJswkdS5JGjhg2cr5xSEnE0b89_RN48Js_kZXyqEDAuy3YComZT1uTzFWq71KS_nPXW9lCm-Y5dKV1ti8AKF4Ob5J7lPFPapKMN4IO4cpdoDm3RkP_lML4ojL_GK1GpEjdusEL3QwWyom3J_eMGvQetr2McSI Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: f3bcb7919eee471b8dd0a728fd6255a7 Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1488342094 Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:37:16.274341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/f3bcb7919eee471b8dd0a728fd6255a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f3bcb7919eee471b8dd0a728fd6255a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f3bcb7919eee471b8dd0a728fd6255a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_f3bcb7919eee471b8dd0a728fd6255a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesSnapshotTestJSON-1488342094 Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: f3bcb7919eee471b8dd0a728fd6255a7 Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1488342094 Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesSnapshotTestJSON-1488342094-project Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 736ad47c636d4172b1a646437ac4feec Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesSnapshotTestJSON-1488342094-project Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance ab62c519-5b7e-4583-b621-54f18218f9e7 could not be found. Aug 29 21:37:16.275798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'ab62c519-5b7e-4583-b621-54f18218f9e7'} Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab62c519-5b7e-4583-b621-54f18218f9e7 could not be found. Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:16.276596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab62c519-5b7e-4583-b621-54f18218f9e7 could not be found. Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab62c519-5b7e-4583-b621-54f18218f9e7 could not be found. Aug 29 21:37:16.277998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:37:16.279378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Returning 404 to user: Instance ab62c519-5b7e-4583-b621-54f18218f9e7 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:16.279378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d95f415f-90bc-4978-8c26-51b720888052 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7" status: 404 len: 111 microversion: 2.1 time: 0.032358 Aug 29 21:37:16.279378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 188/383] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:16 2022] GET /compute/v2.1/servers/ab62c519-5b7e-4583-b621-54f18218f9e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:37:16.513347 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:16.514003 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:16.520073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.520548 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.520979 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.521672 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.522182 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.522602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.663636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.672469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.674022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.675180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1de81187-f1cf-4510-a989-16ef946a6a82 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1744 microversion: 2.20 time: 0.166453 Aug 29 21:37:16.675738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 196/384] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:16 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:16.736096 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:16.736722 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:16.743170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.743653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.744091 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.744774 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.745228 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.745654 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.795996 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-037dff74-1e1c-4569-aede-176889f2ac5d req-c9fca7bc-39dc-4d15-be69-d0bdacc1a838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3819524d-f3cb-4a48-b655-369801192ff1", "tag": "f25a764e-ad4b-498c-a467-cdffc6e6822b"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:16.805868 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-037dff74-1e1c-4569-aede-176889f2ac5d req-c9fca7bc-39dc-4d15-be69-d0bdacc1a838 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:16.806344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-037dff74-1e1c-4569-aede-176889f2ac5d req-c9fca7bc-39dc-4d15-be69-d0bdacc1a838 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:16.806776 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-037dff74-1e1c-4569-aede-176889f2ac5d req-c9fca7bc-39dc-4d15-be69-d0bdacc1a838 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:16.820837 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-037dff74-1e1c-4569-aede-176889f2ac5d req-c9fca7bc-39dc-4d15-be69-d0bdacc1a838 service nova] Creating event network-changed:f25a764e-ad4b-498c-a467-cdffc6e6822b for instance 3819524d-f3cb-4a48-b655-369801192ff1 on hv-cinder-85426 Aug 29 21:37:16.826224 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-037dff74-1e1c-4569-aede-176889f2ac5d req-c9fca7bc-39dc-4d15-be69-d0bdacc1a838 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034083 Aug 29 21:37:16.826838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 197/385] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:16.892587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:16.901266 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3fd52abc-6ceb-482c-b8f6-4c22d554e57c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.170132 Aug 29 21:37:16.901889 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 189/386] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:16 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:17.068772 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:17.069514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:17.071510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:17.079374 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.079900 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.080368 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:17.081225 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.081683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.082138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:17.220260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:17.228073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fd0c39b1-636f-47e4-b0da-694de65c5f2f tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.163715 Aug 29 21:37:17.228650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 198/387] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:17 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:17.700347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:17.701026 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:17.708103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.708596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.709292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:17.710028 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.710495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.710920 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:17.714980 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:17.847560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:17.856493 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:17.857992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:17.859278 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e436d8cc-c6ee-42fe-8981-fbe50fe05bbb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1744 microversion: 2.20 time: 0.162928 Aug 29 21:37:17.859844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 190/388] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:17 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:17.930236 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:17.930848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:17.937463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.937989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.938426 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:17.939130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:17.939583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:17.940006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:18.076932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:18.085399 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c7b3a606-2607-443d-b976-92cf31359bdd tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.158919 Aug 29 21:37:18.086243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 199/389] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:17 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:18.248716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:18.249326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:18.255693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:18.256176 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:18.256608 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:18.257296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:18.257746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:18.258195 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:18.399346 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:18.409139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b4e630e1-04fb-46ae-91d7-2b3e063cad3a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.164328 Aug 29 21:37:18.409849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 191/390] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:18 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:18.678934 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-9d687bcd-5dd4-4429-8f0f-be2e401a84fb req-62d902d2-fbd6-4b2b-a82b-44ad78cd7127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d60cc0-bd66-4d79-a1fc-c673f14f3719", "name": "network-vif-plugged", "status": "completed", "tag": "79623b1d-b179-4248-a2d5-218f0799ca95"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:18.689441 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9d687bcd-5dd4-4429-8f0f-be2e401a84fb req-62d902d2-fbd6-4b2b-a82b-44ad78cd7127 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:18.690049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9d687bcd-5dd4-4429-8f0f-be2e401a84fb req-62d902d2-fbd6-4b2b-a82b-44ad78cd7127 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:18.690468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9d687bcd-5dd4-4429-8f0f-be2e401a84fb req-62d902d2-fbd6-4b2b-a82b-44ad78cd7127 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:18.703539 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-9d687bcd-5dd4-4429-8f0f-be2e401a84fb req-62d902d2-fbd6-4b2b-a82b-44ad78cd7127 service nova] Creating event network-vif-plugged:79623b1d-b179-4248-a2d5-218f0799ca95 for instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 on hv-cinder-85426 Aug 29 21:37:18.708574 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-9d687bcd-5dd4-4429-8f0f-be2e401a84fb req-62d902d2-fbd6-4b2b-a82b-44ad78cd7127 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033359 Aug 29 21:37:18.709439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 200/391] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:18.883430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:18.884051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:18.891608 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:18.892106 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:18.892552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:18.893257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:18.893713 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:18.894169 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:19.032902 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:19.041320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:19.042814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:19.044482 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-dae0ceef-29ae-46ac-a20a-9b22ed4d5b9d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1744 microversion: 2.20 time: 0.165025 Aug 29 21:37:19.045037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 192/392] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:18 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:19.109474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:19.110201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:19.116962 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:19.117381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:19.117842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:19.118543 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:19.118991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:19.119411 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:19.252594 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:19.260471 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a0457ce0-2c0c-46c0-a434-2e72654a2ee2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.156751 Aug 29 21:37:19.261044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 201/393] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:19 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:19.432433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:19.433105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:19.440668 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:19.441163 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:19.441605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:19.442339 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:19.442798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:19.443228 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:19.663845 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:19.675009 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a0d2f4b0-6ae6-4098-ba0a-3d3398f0603b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.246283 Aug 29 21:37:19.675621 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 193/394] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:19 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:20.068516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:20.069115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:20.075732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:20.076209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:20.076637 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:20.077310 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:20.077758 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:20.078199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:20.216633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.228580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.230244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.231558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fcce8717-d901-4cdf-b748-7a12138a0349 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.166947 Aug 29 21:37:20.232254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 202/395] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:20 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:20.283926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:20.284587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:20.291316 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:20.291808 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:20.292306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:20.293004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:20.293997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:20.294723 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:20.529993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.538431 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-89e5a4e7-86bb-4e93-9ee1-52e273463041 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1358 microversion: 2.1 time: 0.260299 Aug 29 21:37:20.539019 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 194/396] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:20 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:20.695841 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:20.696462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:20.705778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:20.706426 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:20.706921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:20.707669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:20.708764 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:20.709450 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:20.887795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:20.897140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2ed88056-1a7c-4a9f-af01-9f6930791da0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.204081 Aug 29 21:37:20.898011 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 203/397] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:20 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:21.300094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:21.304812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:21.333397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.339072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.340220 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.343001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.350434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.351096 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.499692 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.508660 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.510173 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.511548 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ac89e143-6749-4edf-9022-e4a558e8cab1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.258240 Aug 29 21:37:21.522070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 195/398] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:21 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:21.561819 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:21.562729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:21.572369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.573137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.573570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.574292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.574928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.575346 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.724559 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.733325 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a6be4857-6149-4650-8b39-4f44e07f53b8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1548 microversion: 2.1 time: 0.175925 Aug 29 21:37:21.749695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 204/399] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:21 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1548 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:21.754607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:21.755506 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:21.764725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.765542 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.766214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.767003 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.767522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.768009 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.922310 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:21.923163 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:21.936121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.936788 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.937380 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.938907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:21.939511 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:21.940189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:21.955813 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:21.970908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bd479fc6-2d61-4cdc-b1a4-6f6c52f32669 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1548 microversion: 2.1 time: 0.219853 Aug 29 21:37:21.985822 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 196/400] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:21 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:21.996928 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:22.006163 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.009345 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Searching by: {'deleted': False, 'project_id': 'df74318c1e404179bbb8533b5909deb8'} {{(pid=127068) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 21:37:22.025644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.026269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.030213 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.031293 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.033811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.034463 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.155569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.164457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6e183ac1-97b4-44c5-beec-fd8a0b2f0184 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.247076 Aug 29 21:37:22.165738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 205/401] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:21 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:22.192864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.multi_cell_list [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127068) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 21:37:22.354090 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a6d01f15-d740-4df2-9a65-360ca7484799 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.363612 Aug 29 21:37:22.358246 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 197/402] 10.222.0.90 () {58 vars in 1125 bytes} [Mon Aug 29 21:37:21 2022] GET /compute/v2.1/servers => generated 342 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:22.368888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:22.369128 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:22.376892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.377382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.377848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.379017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.379534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.379997 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.539406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:22.540329 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:22.555853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.556351 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.556802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.557502 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:22.557836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.558001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:22.558412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:22.571286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-acd6f52d-ecc8-44e4-87c0-088123162808 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1548 microversion: 2.1 time: 0.206565 Aug 29 21:37:22.572939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 206/403] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:22 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1548 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:22.756840 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.772149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.776956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:22.779717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-761b01e8-29f4-4e3e-8b5e-aec6f2aec703 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.245095 Aug 29 21:37:22.799915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 198/404] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:22 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:23.190245 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:23.191521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:23.198773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:23.201577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:23.202109 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:23.203098 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:23.204070 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:23.205213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:23.380065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:23.389547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7fd9e8e5-d8dc-4e83-a2d3-b06e3a297f81 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.203765 Aug 29 21:37:23.390537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 207/405] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:23 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:23.807198 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:23.807809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:23.815704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:23.816199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:23.816635 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:23.817333 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:23.817809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:23.818222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:24.005559 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:24.020669 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:24.023002 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:24.025955 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-985e3683-c9cc-4a7b-908a-5d3b7900cf7e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.222593 Aug 29 21:37:24.026994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 199/406] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:23 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:24.411682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:24.413098 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:24.421313 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:24.421828 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:24.422271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:24.422983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:24.423474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:24.423903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:24.594725 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:24.603448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-509e3b26-7fd3-47af-aa1d-5e2afe5282e8 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.196370 Aug 29 21:37:24.617692 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 208/407] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:24 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:25.060863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:25.062348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:25.070032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.071548 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.072092 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.072884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.073415 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.073957 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.264270 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:25.274926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:25.276923 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:25.278502 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-073dca09-22dc-43fc-8670-9da9300a3502 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.222932 Aug 29 21:37:25.279529 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 200/408] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:25 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:25.487824 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:25.488615 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:25.497205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.498050 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.498689 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.499639 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.500101 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.500538 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.566984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=100 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:25.627132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:25.627873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:25.635056 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.636059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.636688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.645347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:25.646139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:25.647737 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:25.683355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lazy-loading 'services' on Instance uuid 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:25.851000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a6117ffc-dc04-4d2d-a1eb-baa537ddac71 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-volume_attachments/975c37e0-3981-4e41-9ab5-ed5cac352a8c" status: 202 len: 0 microversion: 2.1 time: 0.368918 Aug 29 21:37:25.852084 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 209/409] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:37:25 2022] DELETE /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-volume_attachments/975c37e0-3981-4e41-9ab5-ed5cac352a8c => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:25.932220 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:25.941884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d889d374-2e5c-48c4-bda1-2e2850381d21 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.321100 Aug 29 21:37:25.945841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 201/410] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:25 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:26.309426 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:26.310279 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:26.318565 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.319373 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.319899 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.320780 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.321486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.322729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.469809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:26.470595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:26.479227 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.487094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.487652 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.488469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.490964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.491911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.581254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:26.586338 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4476f2b7-d8ae-481c-96a0-a71d4fd6f08c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e/ips" status: 200 len: 149 microversion: 2.1 time: 0.120879 Aug 29 21:37:26.587758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 202/411] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:37:26 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e/ips => generated 149 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:26.593218 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee43c980-a261-44df-955a-075f6e9b7e6b"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:26.596063 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:26.603314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:26.605050 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:26.607396 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e0752dd0-ef61-4644-b44c-ade4f27198f6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.304390 Aug 29 21:37:26.608075 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 210/412] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:26 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:26.608451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.608944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.609376 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.610113 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.610561 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.610977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.613692 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00904f44-7dcb-43f1-adfc-58aae3724ddf"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:26.616360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:26.624859 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.625690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.626550 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.627914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:26.628608 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:26.629234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:26.749928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Invalid volume: volume 00904f44-7dcb-43f1-adfc-58aae3724ddf is already attached to instances: d85c8e78-15e9-492f-b705-c725ff867ed0 Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: POST /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e/os-volume_attachments HTTP/1.1 Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 74 Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:37:26.752638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {"volumeAttachment": {"volumeId": "00904f44-7dcb-43f1-adfc-58aae3724ddf"}} Aug 29 21:37:26.755696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Invalid volume: volume 00904f44-7dcb-43f1-adfc-58aae3724ddf is already attached to instances: d85c8e78-15e9-492f-b705-c725ff867ed0 Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'server_id': '416273e0-c330-4270-ac80-9bfbb9ded49e', 'body': {'volumeAttachment': {'volumeId': '00904f44-7dcb-43f1-adfc-58aae3724ddf'}}} Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 00904f44-7dcb-43f1-adfc-58aae3724ddf is already attached to instances: d85c8e78-15e9-492f-b705-c725ff867ed0 Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:26.757264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 00904f44-7dcb-43f1-adfc-58aae3724ddf is already attached to instances: d85c8e78-15e9-492f-b705-c725ff867ed0 Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:26.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 00904f44-7dcb-43f1-adfc-58aae3724ddf is already attached to instances: d85c8e78-15e9-492f-b705-c725ff867ed0 Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 400 to user: Invalid volume: volume 00904f44-7dcb-43f1-adfc-58aae3724ddf is already attached to instances: d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-95e31e0d-62ab-4b24-9c5d-1db47cf8b157 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.146389 Aug 29 21:37:26.763105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 211/413] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:37:26 2022] POST /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:37:26.773990 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-294506946", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "networks": [{"uuid": "fae3cb92-2310-4e90-b384-0c76bbfb207a"}]}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:26.864314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] validate_networks() for [('fae3cb92-2310-4e90-b384-0c76bbfb207a', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:37:27.327413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-74035543-ba70-440b-8a42-b713ed90b35d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738016 Aug 29 21:37:27.328560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 203/414] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:37:26 2022] POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:27.358171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:27.359538 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:27.378121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.379009 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.379692 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.380827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.381861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.383499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.421868 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:37:27.562031 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:27.677311 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-dfea8105-f3d3-4215-9268-4e0bd6e28b7a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 204 len: 0 microversion: 2.1 time: 0.346376 Aug 29 21:37:27.679187 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 204/415] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:37:27 2022] DELETE /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:37:27.691165 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:27.692255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:27.701862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.702322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.703972 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.705631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.706544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.707707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.886545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:37:27.887268 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:37:27.887719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:37:27.888176 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:37:27.888594 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:37:27.903412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.909269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.910029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.911001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:27.911624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:27.912252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:27.938251 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Getting quotas for project f3bcb7919eee471b8dd0a728fd6255a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:37:27.945425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Getting quotas for user 736ad47c636d4172b1a646437ac4feec and project f3bcb7919eee471b8dd0a728fd6255a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:37:27.961638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:37:27.967488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:37:27.977905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:27.989551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2dbc4b48-3c1a-4af3-a504-8941e46375fa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.308618 Aug 29 21:37:27.990687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 205/416] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:27 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:27.996562 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:27.997434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:28.005153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.006079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.006675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.007614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.008424 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.008953 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.036663 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bb57a087-8f0b-4617-813a-8392b55e1a2a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268601 Aug 29 21:37:28.041936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 212/417] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:37:28.048580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:28.050667 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:28.059972 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.072736 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.073417 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.075010 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.075994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.076600 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.356943 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.374462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.384394 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.384652 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-aede359d-6824-452e-9f96-bb2ec38ebf77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1678 microversion: 2.1 time: 0.341280 Aug 29 21:37:28.399774 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 213/418] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:28 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1678 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:28.404566 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.406122 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d32fe766-a959-4eb6-90bf-ddb101a55105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.414189 Aug 29 21:37:28.406913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 206/419] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:27 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:28.411576 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b8c6b719-c726-45d4-b941-56c9ca6afba4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:28.420260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-92a411aa-c3f6-4115-982f-a052ac7f0945 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:28.422570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-92a411aa-c3f6-4115-982f-a052ac7f0945 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:28.437087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8c6b719-c726-45d4-b941-56c9ca6afba4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.437689 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8c6b719-c726-45d4-b941-56c9ca6afba4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.438428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8c6b719-c726-45d4-b941-56c9ca6afba4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.507480 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b8c6b719-c726-45d4-b941-56c9ca6afba4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Going to try to stop instance {{(pid=127068) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:37:28.539867 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-92a411aa-c3f6-4115-982f-a052ac7f0945 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.548435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-92a411aa-c3f6-4115-982f-a052ac7f0945 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1218 microversion: 2.1 time: 0.145736 Aug 29 21:37:28.550986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 214/420] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:28 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:28.607516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b8c6b719-c726-45d4-b941-56c9ca6afba4 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action" status: 202 len: 0 microversion: 2.1 time: 0.199449 Aug 29 21:37:28.608280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 207/421] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:37:28 2022] POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:28.616989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:28.617881 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:28.631546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.632665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.633265 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.641675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:28.642590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:28.643271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:28.888943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:28.897695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b1b3fc9a-134d-42c4-9824-10e6b3014a68 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.285207 Aug 29 21:37:28.898309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 215/422] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:28 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:29.014655 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:29.015735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:29.022259 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.022871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.023309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.024003 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.024455 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.024877 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.207024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:29.219362 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3529deaa-4c13-469d-a590-35bff83ec1cf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.211108 Aug 29 21:37:29.230296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 208/423] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:29 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:29.411925 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:29.412449 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:29.419442 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.420167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.420593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.421448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.422163 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.422731 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.434107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:29.434885 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:29.446260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.446918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.447555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.448262 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.449334 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.452043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.731645 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:29.751412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7a05bb0f-7f9b-452f-973d-5689a78632e9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1678 microversion: 2.1 time: 0.343375 Aug 29 21:37:29.752107 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 216/424] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:29 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:29.753571 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:29.762792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:29.765618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:29.765861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:29.767403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:29.768843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-569bac9d-3f2f-4a0f-9961-436c890a3d1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.339205 Aug 29 21:37:29.769404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 209/425] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:29 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:29.782442 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.783205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.783798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.784910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.785567 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.786196 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.880590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:29.892831 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0f7a1853-9136-47c3-b64f-750007c06df7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1214 microversion: 2.1 time: 0.136893 Aug 29 21:37:29.906224 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 217/426] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:29 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:29.921679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:29.922495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:29.935296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.936876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.938306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.939277 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:29.940938 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:29.941875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:29.987897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-b2a679e3-9e56-43e8-a9cd-1367f68f71ae req-f0b98dd0-372e-4bd8-9672-99df706870d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3819524d-f3cb-4a48-b655-369801192ff1", "name": "network-vif-plugged", "status": "completed", "tag": "f25a764e-ad4b-498c-a467-cdffc6e6822b"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:30.007759 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-b2a679e3-9e56-43e8-a9cd-1367f68f71ae req-f0b98dd0-372e-4bd8-9672-99df706870d5 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.010986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-b2a679e3-9e56-43e8-a9cd-1367f68f71ae req-f0b98dd0-372e-4bd8-9672-99df706870d5 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.014308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-b2a679e3-9e56-43e8-a9cd-1367f68f71ae req-f0b98dd0-372e-4bd8-9672-99df706870d5 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.057958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-b2a679e3-9e56-43e8-a9cd-1367f68f71ae req-f0b98dd0-372e-4bd8-9672-99df706870d5 service nova] Creating event network-vif-plugged:f25a764e-ad4b-498c-a467-cdffc6e6822b for instance 3819524d-f3cb-4a48-b655-369801192ff1 on hv-cinder-85426 Aug 29 21:37:30.077778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-b2a679e3-9e56-43e8-a9cd-1367f68f71ae req-f0b98dd0-372e-4bd8-9672-99df706870d5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089096 Aug 29 21:37:30.081685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 218/427] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:30.235947 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:30.244253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:30.244958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:30.254325 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a48c9488-1b41-455f-aaba-1036a1f9de3d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.337924 Aug 29 21:37:30.271088 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 210/428] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:29 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:30.272165 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.272664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.273105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.274385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.274385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.274827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.613698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:30.637276 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3907b702-ab3b-4ea7-b8d7-6c28c73dcbcf tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.394001 Aug 29 21:37:30.638726 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 219/429] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:30 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:30.775840 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:30.778548 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:30.787602 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.789106 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.790095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.795452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:30.796315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:30.796855 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.797576 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.799225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.824858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.825668 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.826690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:30.827507 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:30.827974 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:30.828404 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.269851 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.270033 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.283393 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c82779e2-d885-44fc-9383-b16c2febdd5f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1678 microversion: 2.1 time: 0.511017 Aug 29 21:37:31.297594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 211/430] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:30 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1678 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:31.297594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:31.297594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:31.305451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.306078 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.306454 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.307166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.307662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.308188 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.315589 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.317302 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.319644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-54dfe54f-c217-4f37-bada-5a41cfe876f8 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.528343 Aug 29 21:37:31.334665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 220/431] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:30 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:31.339593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:31.341169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:31.354281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.354776 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.355955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.355955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.356505 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.356796 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.427871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.438384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-936ca67d-3de4-47d5-9966-026c48d2f5af tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1270 microversion: 2.1 time: 0.152059 Aug 29 21:37:31.452597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 212/432] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:31 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:31.662350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:31.663378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:31.671749 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.672804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.673467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.675342 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:31.676287 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:31.677141 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:31.729992 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:31.743831 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7a17a299-19dc-4d41-8539-1e74ae021626 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.408006 Aug 29 21:37:31.744961 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 221/433] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:31 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:32.120665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:32.160730 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:32.161444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.172149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.173280 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.174370 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.175725 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.176617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.177446 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.193991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.209359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7a26244d-0e40-4a90-b135-2d844bc3bc31 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1261 microversion: 2.1 time: 0.552118 Aug 29 21:37:32.210094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 213/434] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:31 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1261 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:32.314587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:32.315245 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.330585 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.331097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.331541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.332259 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.332722 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.333157 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.533983 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.546034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0c066006-9076-4b3d-a77e-a50513859f44 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1611 microversion: 2.1 time: 0.235365 Aug 29 21:37:32.558445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 214/435] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:32 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1611 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:32.566511 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:32.567439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.576738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.577529 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.578206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.579201 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.579868 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.580462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.597436 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.612819 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c97365f2-3d4a-4dbc-b585-8ee8057c23fe tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1594 microversion: 2.1 time: 0.458299 Aug 29 21:37:32.613863 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 222/436] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:32 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1594 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:32.619060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-cd21f27c-86a4-4ff6-9cfd-bfb589f8e615 req-a4a72735-e1ac-415c-8216-4862b67bfb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416273e0-c330-4270-ac80-9bfbb9ded49e", "name": "network-vif-deleted", "tag": "f5bc6534-7aba-4509-9463-f64269484484"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:32.634539 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-cd21f27c-86a4-4ff6-9cfd-bfb589f8e615 req-a4a72735-e1ac-415c-8216-4862b67bfb4a service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.640727 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-cd21f27c-86a4-4ff6-9cfd-bfb589f8e615 req-a4a72735-e1ac-415c-8216-4862b67bfb4a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.641623 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-cd21f27c-86a4-4ff6-9cfd-bfb589f8e615 req-a4a72735-e1ac-415c-8216-4862b67bfb4a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.657526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-cd21f27c-86a4-4ff6-9cfd-bfb589f8e615 req-a4a72735-e1ac-415c-8216-4862b67bfb4a service nova] Creating event network-vif-deleted:f5bc6534-7aba-4509-9463-f64269484484 for instance 416273e0-c330-4270-ac80-9bfbb9ded49e on hv-cinder-85426 Aug 29 21:37:32.663195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-cd21f27c-86a4-4ff6-9cfd-bfb589f8e615 req-a4a72735-e1ac-415c-8216-4862b67bfb4a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047976 Aug 29 21:37:32.664307 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 223/437] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:32.670813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:32.671727 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.678371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.679109 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.680076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.680956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.681574 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.682878 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.824382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.844296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-277a613e-4552-4457-ac37-c408f2db3c72 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1276 microversion: 2.1 time: 0.178579 Aug 29 21:37:32.844932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 224/438] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:32 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:32.849864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:32.850822 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:32.868595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.869493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.882724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.883712 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:32.884327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:32.885141 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:32.940777 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.952042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.964048 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:32.966286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-87cd490e-c951-4840-92ba-07dd6829f588 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1739 microversion: 2.20 time: 0.406494 Aug 29 21:37:32.967036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 215/439] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:32 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:33.104644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:33.123170 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-46050f77-bd12-4ee3-82af-a1ddcc537649 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.277065 Aug 29 21:37:33.126818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 225/440] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:32 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:33.234718 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:33.236379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:33.253804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.254865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.254865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.255423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.255872 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.256745 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.572132 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:33.573505 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:33.589361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.590878 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.593962 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.620127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.623186 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.623997 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.676528 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.677934 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.678827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.679742 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid 416273e0-c330-4270-ac80-9bfbb9ded49e {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:33.890418 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:33.908348 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-65c835a5-2580-4695-99c2-c4b21f0bdec7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1329 microversion: 2.1 time: 0.341378 Aug 29 21:37:33.918234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 226/441] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:33 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1329 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:33.930121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:33.937313 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:33.957031 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.958006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.958460 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:33.959444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:33.959903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:33.960328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.012519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.021735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f8060fd5-3f8e-4461-8584-cf7c4d8a59a1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1444 microversion: 2.1 time: 0.792474 Aug 29 21:37:34.028119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 216/442] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:33 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1444 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:34.037755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:34.038629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:34.051363 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.052214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.054995 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.056017 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.058077 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.062421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.134703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.151227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a9d87b39-a67d-4ce0-bff9-abe67cc5fc8f tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1276 microversion: 2.1 time: 0.228341 Aug 29 21:37:34.152053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 227/443] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:33 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:34.167268 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:34.170545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:34.186164 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.188972 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.189621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.190544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.193254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.193934 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.205509 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:34.417037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.430939 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.433448 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.435734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-955dc48f-47c3-4258-9633-66e2529c14d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1721 microversion: 2.20 time: 0.406368 Aug 29 21:37:34.438520 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 217/444] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:34 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:34.446281 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:34.448028 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:34.459624 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.460793 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.461438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.473870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.474755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.476151 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.570696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.579537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fb6cd0fa-b712-47aa-958b-3bbf9e4fc3d3 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1444 microversion: 2.1 time: 0.423548 Aug 29 21:37:34.580191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 228/445] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:34 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1444 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:34.599674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-1eac95e4-cd9f-43dc-9945-c67d8f149154 req-15099c40-9ad0-4885-abe8-d191371fcf5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d60cc0-bd66-4d79-a1fc-c673f14f3719", "name": "network-vif-unplugged", "status": "completed", "tag": "79623b1d-b179-4248-a2d5-218f0799ca95"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:34.623359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-1eac95e4-cd9f-43dc-9945-c67d8f149154 req-15099c40-9ad0-4885-abe8-d191371fcf5d service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.628240 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-1eac95e4-cd9f-43dc-9945-c67d8f149154 req-15099c40-9ad0-4885-abe8-d191371fcf5d service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.628884 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-1eac95e4-cd9f-43dc-9945-c67d8f149154 req-15099c40-9ad0-4885-abe8-d191371fcf5d service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.653610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-1eac95e4-cd9f-43dc-9945-c67d8f149154 req-15099c40-9ad0-4885-abe8-d191371fcf5d service nova] Creating event network-vif-unplugged:79623b1d-b179-4248-a2d5-218f0799ca95 for instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 on hv-cinder-85426 Aug 29 21:37:34.670429 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-1eac95e4-cd9f-43dc-9945-c67d8f149154 req-15099c40-9ad0-4885-abe8-d191371fcf5d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088975 Aug 29 21:37:34.671040 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 229/446] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:34.843000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:34.867276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-187cc5e2-f2ea-4329-a404-feddccaed9b5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.426592 Aug 29 21:37:34.868412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 218/447] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:34 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:34.938683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:34.939733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:34.966607 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.967469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.968273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:34.969822 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:34.971109 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:34.971998 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.074496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.079873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.080450 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.080996 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid 416273e0-c330-4270-ac80-9bfbb9ded49e {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:35.176319 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.177134 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.184117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.185664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.186522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.187506 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.188118 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.189450 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.204816 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:35.220336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7192ced0-7db4-4fb9-9983-d6b9574ca2a1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 200 len: 1329 microversion: 2.1 time: 0.288476 Aug 29 21:37:35.221210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 230/448] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:34 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 1329 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:35.226100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:35.354762 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-7453c21f-40ae-4586-a7a9-90c2be327e78 req-4410c96a-849f-4e96-810d-c99c94ac5b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05755de8-1f0b-44f4-b4b5-028155749387", "tag": "6b29b603-5e32-403d-b02a-7c8b33c0dc37"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:35.369195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7453c21f-40ae-4586-a7a9-90c2be327e78 req-4410c96a-849f-4e96-810d-c99c94ac5b33 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.369832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7453c21f-40ae-4586-a7a9-90c2be327e78 req-4410c96a-849f-4e96-810d-c99c94ac5b33 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.370349 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7453c21f-40ae-4586-a7a9-90c2be327e78 req-4410c96a-849f-4e96-810d-c99c94ac5b33 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.387405 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-7453c21f-40ae-4586-a7a9-90c2be327e78 req-4410c96a-849f-4e96-810d-c99c94ac5b33 service nova] Creating event network-changed:6b29b603-5e32-403d-b02a-7c8b33c0dc37 for instance 05755de8-1f0b-44f4-b4b5-028155749387 on hv-cinder-85426 Aug 29 21:37:35.394521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-7453c21f-40ae-4586-a7a9-90c2be327e78 req-4410c96a-849f-4e96-810d-c99c94ac5b33 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043691 Aug 29 21:37:35.396129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 231/449] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:35.470760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.471665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.479264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.480903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.481529 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.482554 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.483466 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.484622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.837300 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:35.849199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-10fd67fc-f2fe-4052-9fbb-f137e198f795 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.677306 Aug 29 21:37:35.850287 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 219/450] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:35 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:35.892327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:35.893768 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:35.909264 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.910599 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.911868 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:35.913425 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:35.914550 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:35.915583 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.196103 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:36.207025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:36.210974 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:36.213494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-892b0f13-9115-4329-93d8-b1901a80053e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1721 microversion: 2.20 time: 0.752855 Aug 29 21:37:36.227094 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 232/451] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:35 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1721 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:36.242680 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:36.243826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:36.251274 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.252135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.253048 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.254280 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.261635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.262499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.288807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e HTTP/1.1 Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:37:36.291210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:37:36.293570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '416273e0-c330-4270-ac80-9bfbb9ded49e'} Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:37:36.294631 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:37:36.295939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:37:36.297045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:37:36.297045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2b45b1eb-59b5-4ad2-ba7b-d0cec13747d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 404 len: 111 microversion: 2.1 time: 0.054513 Aug 29 21:37:36.297045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 233/452] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:36 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:37:36.303450 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e74f2533-d198-4078-83c4-849d68738b77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '.version_select at 0x7f8bdf85ce50>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:36.335531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e74f2533-d198-4078-83c4-849d68738b77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62817663" status: 202 len: 0 microversion: 2.1 time: 0.036684 Aug 29 21:37:36.337086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 234/453] 10.222.0.90 () {58 vars in 1215 bytes} [Mon Aug 29 21:37:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62817663 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:36.477527 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a29f46d-6746-4a8c-b3c0-2c37519855a1"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:36.481236 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:36.500130 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:36.525371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.528411 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.530330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.540801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-35719608-500a-4c8e-8fed-6d55f4097ded tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.647242 Aug 29 21:37:36.541331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.545752 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 220/454] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:35 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:36.546437 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.547204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.875255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:36.876363 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:36.885824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.886658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.887199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:36.888012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:36.888945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:36.889562 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:37.538679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.551325 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-91cf23f1-b279-4df9-b0ca-c2609423e6d3 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.683396 Aug 29 21:37:37.552479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 221/455] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:36 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:37.560734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:37.562364 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:37.584433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:37.588917 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:37.591057 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:37.595233 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:37.596038 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:37.597087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:37.926693 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:37.959163 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.976596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.978487 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:37.979705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-aacd26e3-4e41-462e-9b56-e40579f4f3df tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1721 microversion: 2.20 time: 0.425777 Aug 29 21:37:37.980888 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 222/456] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:37 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1721 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:37.985765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-fe53f16e-b112-4650-ba5e-2c31eb0f97cf req-842701ca-5c7e-487a-91df-281ae79a77a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26", "tag": "2d4c1a77-dc4f-4efc-8f52-7085ada3e8db"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:37.999342 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-fe53f16e-b112-4650-ba5e-2c31eb0f97cf req-842701ca-5c7e-487a-91df-281ae79a77a4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:37.999863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-fe53f16e-b112-4650-ba5e-2c31eb0f97cf req-842701ca-5c7e-487a-91df-281ae79a77a4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.000306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-fe53f16e-b112-4650-ba5e-2c31eb0f97cf req-842701ca-5c7e-487a-91df-281ae79a77a4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.012726 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-fe53f16e-b112-4650-ba5e-2c31eb0f97cf req-842701ca-5c7e-487a-91df-281ae79a77a4 service nova] Creating event network-changed:2d4c1a77-dc4f-4efc-8f52-7085ada3e8db for instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 on hv-cinder-85426 Aug 29 21:37:38.018612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-fe53f16e-b112-4650-ba5e-2c31eb0f97cf req-842701ca-5c7e-487a-91df-281ae79a77a4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035712 Aug 29 21:37:38.019147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 223/457] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:38.024788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:38.025614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:38.034827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.035807 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.036309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.037220 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.037688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.038140 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.302682 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:38.323051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ea5fcba6-feeb-45c6-81b9-d35eebc1f6c6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.297611 Aug 29 21:37:38.323860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 224/458] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:38 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:38.328897 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2131347049"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:38.329428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:38.336176 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.337043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.337566 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.338490 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.338949 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.339908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.469431 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5a4488fc-a771-4995-89b2-9dd52cc458d0 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.997774 Aug 29 21:37:38.470084 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 235/459] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:37:36 2022] POST /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments => generated 194 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:38.475907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:38.476493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:38.495329 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.496042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.496689 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.497399 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.498026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.498688 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.548572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=8 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:38.629014 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'services' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:38.759308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-810a772e-6dfb-46c7-afe4-6941c0ee99e4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments/00904f44-7dcb-43f1-adfc-58aae3724ddf" status: 202 len: 0 microversion: 2.1 time: 0.287719 Aug 29 21:37:38.759994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 236/460] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:37:38 2022] DELETE /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments/00904f44-7dcb-43f1-adfc-58aae3724ddf => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:38.768605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:38.769297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:38.773610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:38.782502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.783055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.783721 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.784439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:38.784893 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:38.785305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:38.956805 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.network.security_group_api [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Adding security group 14178fc8-477d-45b5-abe2-0923aa94d89f to port 6b29b603-5e32-403d-b02a-7c8b33c0dc37 Aug 29 21:37:39.489383 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:39.497791 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c3b728a2-8be0-4b58-896e-a04436e40db1 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.736334 Aug 29 21:37:39.498386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 237/461] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:38 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:39.505716 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:39.509428 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:39.516837 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.517315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.517743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.518473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.518918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.519340 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.552481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0475759c-d1d1-49a7-8b45-31146bed7c4a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053033 Aug 29 21:37:39.553063 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 238/462] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:39 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:39.557484 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:39.558700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:39.564612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.565081 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.565511 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:39.566340 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:39.566852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:39.567268 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.137362 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:40.146757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:40.148372 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:40.149619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ab6b102b-a357-47f3-85de-147b7c17f084 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1664 microversion: 2.20 time: 0.595642 Aug 29 21:37:40.150288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 239/463] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:39 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1664 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:40.161916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:40.161916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:40.164272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.164833 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.165341 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.166149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.166674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.167995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.550180 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-74da02c5-2342-4ce6-984d-b68469e85a75 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/action" status: 202 len: 0 microversion: 2.1 time: 2.222502 Aug 29 21:37:40.552792 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 225/464] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:37:38 2022] POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/action => generated 0 bytes in 2228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:40.560568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3a17ea-9219-4142-9287-b641cd2c9571"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:40.563075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:40.571598 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.572505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.573381 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.575343 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.575955 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.576452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.710205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:40.715963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5fd92b53-550a-487f-9336-18a33dd605a8 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.564415 Aug 29 21:37:40.726938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 240/465] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:40 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:40.741281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:40.742421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:40.750506 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.750876 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.751210 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:40.752209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:40.753259 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:40.754121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.008726 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-594efaef-46cb-4fd4-8fd3-66210ed67a88 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.454353 Aug 29 21:37:41.009489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 226/466] 10.222.0.90 () {62 vars in 1364 bytes} [Mon Aug 29 21:37:40 2022] POST /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments => generated 188 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:37:41.022647 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:41.023388 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:41.029333 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:41.044073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-947ae8e7-90b4-4790-b212-e4bca76c7db9 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.315935 Aug 29 21:37:41.050204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 241/467] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:40 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:41.056231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.058681 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.059940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.060993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.061714 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.062498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-74fc64d2-d512-4bba-baca-0a90f60124d6 req-7e3aa864-8ebc-456a-84dc-dd03a0934a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05755de8-1f0b-44f4-b4b5-028155749387", "tag": "6b29b603-5e32-403d-b02a-7c8b33c0dc37"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:41.063070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.075612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-74fc64d2-d512-4bba-baca-0a90f60124d6 req-7e3aa864-8ebc-456a-84dc-dd03a0934a3b service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.076217 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-74fc64d2-d512-4bba-baca-0a90f60124d6 req-7e3aa864-8ebc-456a-84dc-dd03a0934a3b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.076751 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-74fc64d2-d512-4bba-baca-0a90f60124d6 req-7e3aa864-8ebc-456a-84dc-dd03a0934a3b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.094411 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-74fc64d2-d512-4bba-baca-0a90f60124d6 req-7e3aa864-8ebc-456a-84dc-dd03a0934a3b service nova] Creating event network-changed:6b29b603-5e32-403d-b02a-7c8b33c0dc37 for instance 05755de8-1f0b-44f4-b4b5-028155749387 on hv-cinder-85426 Aug 29 21:37:41.100753 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-74fc64d2-d512-4bba-baca-0a90f60124d6 req-7e3aa864-8ebc-456a-84dc-dd03a0934a3b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048960 Aug 29 21:37:41.102136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 242/468] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:41.110151 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:41.114214 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:41.122321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.123398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.124476 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.125375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.126032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.126657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.165044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-381ab113-077b-41b1-a315-5583586bdf90 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061135 Aug 29 21:37:41.166036 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 243/469] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:41 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:41.181175 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:41.181775 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:41.188761 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.189252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.189683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.190594 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.191204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.191797 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.242221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127069) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:37:41.281818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:41.293520 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9a57794b-a1c6-465c-881d-0013ad47a404 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1759 microversion: 2.1 time: 0.273866 Aug 29 21:37:41.294625 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 227/470] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:41 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1759 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:41.320598 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c261e183-ec22-40b6-a2b4-bad0e05009f4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/action" status: 202 len: 0 microversion: 2.20 time: 0.143432 Aug 29 21:37:41.325877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 244/471] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 21:37:41 2022] POST /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:37:41.335370 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:41.336170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:41.344660 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.345531 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.346306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.347192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.347814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.348489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.500398 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:41.513967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:41.515629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:41.516837 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-411dddd7-926c-4039-b73b-08c9eba04602 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1750 microversion: 2.20 time: 0.188582 Aug 29 21:37:41.518374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 228/472] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:41 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:41.740886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:41.742309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:41.753001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.755198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.755825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.756716 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:41.757352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:41.758008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:41.765485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:41.943055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:41.960572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-aa8fa990-47e9-420a-9ae8-1457eee054f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.224677 Aug 29 21:37:41.961697 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 245/473] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:41 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:42.074327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:42.075797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:42.093296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.094941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.097603 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.103071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.103865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.110195 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.192782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:42.195305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:42.210502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.211758 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.212666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.214146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.215133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.217584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.284202 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cfc89a7f-b7b0-439a-8dd4-2cbfdc6d3fbd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103932 Aug 29 21:37:42.288493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 246/474] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:42 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:42.400928 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:42.412183 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-01e656dd-3d02-452a-996e-ee5d301631b7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.347419 Aug 29 21:37:42.413036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 229/475] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:42 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:42.542902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:42.543921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:42.550733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.551232 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.552373 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.553128 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.553597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.554052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.750619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:42.762433 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:42.764162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:42.765701 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a46208a2-077f-482f-befd-1e5c958ba429 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1752 microversion: 2.20 time: 0.229448 Aug 29 21:37:42.772633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 247/476] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:42 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1752 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:42.988565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:42.989077 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:42.991179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:42.997648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.998169 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:42.998609 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:42.999306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:42.999790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.000213 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.296611 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:43.298943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:43.305174 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.305659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.306126 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.306908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.307369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.308302 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.340995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2e821290-2cec-43a6-b97b-80af4201fc70 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048334 Aug 29 21:37:43.341570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 248/477] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:43 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:43.345874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-260820cb-a286-43a2-9bd6-c972750bc7e5 req-ba331109-112b-4f41-bc04-89ec2b08d197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3819524d-f3cb-4a48-b655-369801192ff1", "tag": "f25a764e-ad4b-498c-a467-cdffc6e6822b"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:43.355381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-260820cb-a286-43a2-9bd6-c972750bc7e5 req-ba331109-112b-4f41-bc04-89ec2b08d197 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.355875 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-260820cb-a286-43a2-9bd6-c972750bc7e5 req-ba331109-112b-4f41-bc04-89ec2b08d197 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.356307 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-260820cb-a286-43a2-9bd6-c972750bc7e5 req-ba331109-112b-4f41-bc04-89ec2b08d197 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.367615 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-260820cb-a286-43a2-9bd6-c972750bc7e5 req-ba331109-112b-4f41-bc04-89ec2b08d197 service nova] Creating event network-changed:f25a764e-ad4b-498c-a467-cdffc6e6822b for instance 3819524d-f3cb-4a48-b655-369801192ff1 on hv-cinder-85426 Aug 29 21:37:43.372964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-260820cb-a286-43a2-9bd6-c972750bc7e5 req-ba331109-112b-4f41-bc04-89ec2b08d197 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030262 Aug 29 21:37:43.373585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 249/478] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:43.378045 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:43.387537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c075ba9b-a9ff-456f-8a2a-2a7b1e68457d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.401832 Aug 29 21:37:43.388326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 230/479] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:42 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:43.435818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:43.436526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:43.442888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.443368 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.443838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.444531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.444981 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.445406 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.662772 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:43.671181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-da6558f7-2098-4c19-8919-fd40953ed9a7 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.240735 Aug 29 21:37:43.671757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 250/480] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:43 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:43.791355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:43.792901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:43.799406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.799971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.800478 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.801421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.802193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.802634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.931826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-9c0515c5-92bf-4b36-ba45-613269d56070 req-1c23d34f-7483-4435-86b7-f98568020055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26", "name": "network-vif-plugged", "status": "completed", "tag": "2d4c1a77-dc4f-4efc-8f52-7085ada3e8db"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:43.942337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9c0515c5-92bf-4b36-ba45-613269d56070 req-1c23d34f-7483-4435-86b7-f98568020055 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:43.943086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9c0515c5-92bf-4b36-ba45-613269d56070 req-1c23d34f-7483-4435-86b7-f98568020055 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:43.943677 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9c0515c5-92bf-4b36-ba45-613269d56070 req-1c23d34f-7483-4435-86b7-f98568020055 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:43.958100 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-9c0515c5-92bf-4b36-ba45-613269d56070 req-1c23d34f-7483-4435-86b7-f98568020055 service nova] Creating event network-vif-plugged:2d4c1a77-dc4f-4efc-8f52-7085ada3e8db for instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 on hv-cinder-85426 Aug 29 21:37:43.963537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-9c0515c5-92bf-4b36-ba45-613269d56070 req-1c23d34f-7483-4435-86b7-f98568020055 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035296 Aug 29 21:37:43.964883 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 251/481] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:44.021141 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:44.031391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:44.033237 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:44.034757 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-04abbed9-f744-4d14-9462-13a06748bfc3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1752 microversion: 2.20 time: 0.247503 Aug 29 21:37:44.035741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 231/482] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:43 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:44.355045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:44.357585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:44.364153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.364640 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.365065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.365755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.366228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.366643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.400220 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-52928cdb-7e86-4c14-9dcb-38df12ebe412 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050703 Aug 29 21:37:44.400790 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 252/483] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:44 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:44.408872 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:44.409408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:44.416079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.416566 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.417573 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.418348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.418806 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.419231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.559628 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:44.567596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0c310eea-88b5-4f51-a581-9cede6a28ec0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1678 microversion: 2.1 time: 0.162606 Aug 29 21:37:44.568207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 232/484] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:44 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:44.692653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:44.693327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:44.699365 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.699848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.700285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.700977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:44.701458 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:44.701995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:44.835645 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:44.845168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cd0284e0-390a-4c08-8fb4-195f668dcfb0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.156431 Aug 29 21:37:44.845755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 253/485] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:44 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:45.058677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:45.059285 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:45.065377 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.065898 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.066341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.067027 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.067558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.067990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.203948 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:45.213283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:45.216073 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:45.217932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-283f0789-d413-4ee5-9f7e-18a59817455b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1752 microversion: 2.20 time: 0.163013 Aug 29 21:37:45.218774 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 233/486] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:45 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:45.412972 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:45.415170 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:45.422143 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.422624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.423126 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.424136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.424745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.425976 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.460595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dc695024-ebce-4aa9-b247-0c85d501c8d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051338 Aug 29 21:37:45.461087 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 254/487] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:45 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:45.591835 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:45.592444 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:45.598992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.599480 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.599945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.600632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.601089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.601518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.620527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:45.738698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:45.747050 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ab6f2169-647f-471e-93d4-3bc52ce5098e tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1655 microversion: 2.1 time: 0.159150 Aug 29 21:37:45.747628 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 234/488] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:45 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:45.767534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-55680bd7-8e05-4e5d-b277-771f27bd2cf5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:45.773510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55680bd7-8e05-4e5d-b277-771f27bd2cf5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.774028 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55680bd7-8e05-4e5d-b277-771f27bd2cf5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.774461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55680bd7-8e05-4e5d-b277-771f27bd2cf5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.796798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-55680bd7-8e05-4e5d-b277-771f27bd2cf5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Going to try to start instance {{(pid=127069) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:37:45.842419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-55680bd7-8e05-4e5d-b277-771f27bd2cf5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action" status: 202 len: 0 microversion: 2.1 time: 0.078498 Aug 29 21:37:45.845568 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 255/489] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:37:45 2022] POST /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:37:45.851217 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:45.851831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:45.859257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.859748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.860186 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.860991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.861459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.861894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.867832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:45.868544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:45.875471 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.875942 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.876367 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:45.877044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:45.877491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:45.877966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.106388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:46.109364 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:46.115320 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6c2e2911-1f85-4415-a7d4-1228a18e6580 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1318 microversion: 2.1 time: 0.251587 Aug 29 21:37:46.118701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-63923b4c-a918-4e26-8f03-cfe38f2c4e7c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1664 microversion: 2.1 time: 0.271157 Aug 29 21:37:46.119401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 235/490] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:45 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:46.128658 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 256/491] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:45 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:46.250437 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:46.250996 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:46.256948 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.257433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.257910 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.258600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.259051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.259477 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.399438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:46.409820 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:46.411269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:46.412441 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a8d4d3c5-9033-4d76-bfcd-356ce2d0b688 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1752 microversion: 2.20 time: 0.166057 Aug 29 21:37:46.413013 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 236/492] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:46 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:46.473344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:46.475586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:46.482627 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.483104 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.483536 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.484233 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:46.484687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:46.485107 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:46.516622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d81ef293-814e-47dd-92a0-72f1f2ed9d42 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047459 Aug 29 21:37:46.517111 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 257/493] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:46 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:47.138649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:47.139274 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.140737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:47.141439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.148080 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.148412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.148926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.150515 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.151050 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.152785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.157442 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.157978 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.158430 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.159156 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.159883 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.160062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.470243 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:47.475626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:47.479357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-82e61bd3-0064-4696-b141-cec57878e12d tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1506 microversion: 2.1 time: 0.346700 Aug 29 21:37:47.486510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a240a952-0845-44e9-b9c8-865655cc59bc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1664 microversion: 2.1 time: 0.350940 Aug 29 21:37:47.487088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 258/494] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:47 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1664 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:47.492102 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:47.494393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.502233 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.503044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.503437 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.504161 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.504464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 237/495] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:47 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:47.504959 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.505566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.510062 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:47.511340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.518682 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.519183 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.519623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.522735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.522735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.522735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.559204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'flavor' on Instance uuid 74dc22ba-7b20-4480-90d8-f249f55b1a6f {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:47.701822 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8cfbf834-54c3-4624-816d-818e52da978c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/action" status: 200 len: 32 microversion: 2.1 time: 0.213452 Aug 29 21:37:47.702483 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 259/496] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:37:47 2022] POST /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:37:47.707963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "292e666d-011c-45d0-95bc-c95362938313", "device": "/dev/sdb"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:47.710835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.717364 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.717865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.718295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.719025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.719452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.719850 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.726255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:47.763519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:47.776761 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:47.778694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:47.779887 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a975acd3-86ae-4fbb-a15d-d6692e6ff5d9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1752 microversion: 2.20 time: 0.274378 Aug 29 21:37:47.780853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 238/497] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:47 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1752 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:47.786189 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:47.788656 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.795256 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.795748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.796181 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.797120 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.797575 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.798138 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.832119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ffdc54fe-5615-4ef5-ab4d-2e8f60925c59 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050197 Aug 29 21:37:47.832843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 239/498] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:37:47 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:37:47.840275 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:47.843064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:47.853290 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.855539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.855539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:47.856892 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:47.857373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:47.857844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.096822 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-13c670da-00e8-4692-a404-80700cefc05b tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "POST /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392529 Aug 29 21:37:48.098153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 260/499] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:37:47 2022] POST /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:37:48.115186 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:48.115774 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:48.129584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.130106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.130534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.131228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.131609 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.139015 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.139484 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.142075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6215dfd3-a60b-47c1-b1c9-e0469fcfd767 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.306931 Aug 29 21:37:48.143142 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 240/500] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:47 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:48.194575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:37:48.295993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cf3eee51-af2e-4a52-a0dd-ddac6c25b721 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 204 len: 0 microversion: 2.1 time: 0.196070 Aug 29 21:37:48.296629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 261/501] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:37:48 2022] DELETE /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:37:48.304892 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:48.305752 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:48.312970 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.313508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.313993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.314838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.315288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.315868 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.480802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.492097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-21eb4211-60b8-4c68-9771-cbb07085b291 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1683 microversion: 2.1 time: 0.191091 Aug 29 21:37:48.492684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 241/502] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:48 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:48.508061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:48.508783 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:48.515959 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.516441 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.517116 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.517824 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.518270 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.518685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.654956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.662705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f1ec937d-6965-439e-aa6f-c69deb54742f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1664 microversion: 2.1 time: 0.159008 Aug 29 21:37:48.663262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 262/503] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:48 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:48.804579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:48.805189 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:48.812614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.813109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.813553 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.814283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:48.814739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:48.815192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:48.952011 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.962924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.964916 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:48.966179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-95029d6d-95dc-4075-9349-5704476f1a75 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.165603 Aug 29 21:37:48.966969 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 242/504] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:48 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:49.168235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:49.168832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:49.175486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.175964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.176390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.177076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.177522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.177975 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.320125 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:49.328349 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-680ad488-90a8-4936-9bd7-dae40acdc24d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.164605 Aug 29 21:37:49.328917 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 263/505] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:49 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:49.515481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:49.516039 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:49.523405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.523892 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.524329 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.525021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.525505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.525963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.657704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:49.665665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d3490b21-9468-447c-a121-ffe5c913b820 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1683 microversion: 2.1 time: 0.154996 Aug 29 21:37:49.666265 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 243/506] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:49 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:49.684372 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:49.684970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:49.691278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.691769 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.692219 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.692916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:49.693368 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:49.693816 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:49.827021 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:49.835032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4cc76f4a-e88a-4b4c-87c6-7ca155b35610 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1664 microversion: 2.1 time: 0.154550 Aug 29 21:37:49.835599 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 264/507] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:49 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:49.993521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:49.994573 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:50.006469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.006966 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.007498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.008198 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.008654 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.009077 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.151803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:50.160644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:50.162127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:50.163297 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bdcbfafd-fc9f-44f6-8709-605ec2cb20dd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.175122 Aug 29 21:37:50.163874 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 244/508] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:49 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:50.350171 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:50.350789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:50.357597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.358144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.358584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.359284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.360388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.360388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.497189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:50.505546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-52c8c3aa-b807-4b91-bbe0-98cf297d33fb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.159822 Aug 29 21:37:50.506157 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 265/509] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:50 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:50.686809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:50.687350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:50.694064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.694554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.694992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.695685 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.696135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.696569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.858452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:50.858452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:50.864791 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.865282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.865717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:50.866746 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:50.867159 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:50.868215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:51.042232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:51.051421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2523e674-6dd9-4c4c-b0f9-fb96d2050736 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1683 microversion: 2.1 time: 0.368622 Aug 29 21:37:51.052488 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 245/510] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:50 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1683 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:51.186831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:51.187730 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:51.190264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:51.194449 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:51.195000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:51.195506 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:51.196293 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:51.196860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:51.197355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:51.200000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bae21c44-684d-4046-a9b6-dc4e7413034a tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1668 microversion: 2.1 time: 0.347600 Aug 29 21:37:51.214765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 266/511] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:50 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1668 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:51.444101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:51.453738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:51.455143 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:51.456309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b66d6d72-ea8e-468a-b017-1385c2636378 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.273514 Aug 29 21:37:51.469993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 246/512] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:51 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:37:51.528276 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:51.528885 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:51.540552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:51.541094 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:51.541527 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:51.542457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:51.543212 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:51.543354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.073479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:52.074157 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:52.080940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.081431 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.081906 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.082612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.083068 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.083751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.085254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.095909 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e5c7493e-a688-4b70-b75c-805161f91065 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.572980 Aug 29 21:37:52.096607 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 267/513] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:51 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:52.164026 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.173190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0731123f-c878-44b7-97c2-fd59102de1a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1615 microversion: 2.1 time: 0.103545 Aug 29 21:37:52.173814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 247/514] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:52 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:52.479947 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:52.480709 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:52.486967 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.487490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.487897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.488602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.489084 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.489550 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.753839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-02bc646c-a1b2-4684-b56c-e19297ff2484 req-5b0594c2-8778-4e3f-9ed9-292710b4ec39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85c8e78-15e9-492f-b705-c725ff867ed0", "name": "network-vif-deleted", "tag": "49318983-234b-42f9-9a16-3528f5def815"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:37:52.774269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-02bc646c-a1b2-4684-b56c-e19297ff2484 req-5b0594c2-8778-4e3f-9ed9-292710b4ec39 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:52.775265 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-02bc646c-a1b2-4684-b56c-e19297ff2484 req-5b0594c2-8778-4e3f-9ed9-292710b4ec39 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:52.775401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-02bc646c-a1b2-4684-b56c-e19297ff2484 req-5b0594c2-8778-4e3f-9ed9-292710b4ec39 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:52.791271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-02bc646c-a1b2-4684-b56c-e19297ff2484 req-5b0594c2-8778-4e3f-9ed9-292710b4ec39 service nova] Creating event network-vif-deleted:49318983-234b-42f9-9a16-3528f5def815 for instance d85c8e78-15e9-492f-b705-c725ff867ed0 on hv-cinder-85426 Aug 29 21:37:52.797630 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-02bc646c-a1b2-4684-b56c-e19297ff2484 req-5b0594c2-8778-4e3f-9ed9-292710b4ec39 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048157 Aug 29 21:37:52.799777 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 248/515] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:37:52.833522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.850301 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.851773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:52.852973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fa125622-7923-4980-874d-6fec82bc1504 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.377243 Aug 29 21:37:52.853522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 268/516] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:52 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:53.121053 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:53.122190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:53.133440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.134181 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.134807 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.136819 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.137480 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.138115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.196296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:53.196907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:53.219763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.220986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.222119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.223012 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.223484 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.223915 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.291323 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.292538 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.293273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.293743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:53.375707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:53.387464 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ceb30352-b1d3-487f-a469-69799e932dd4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.196271 Aug 29 21:37:53.396037 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 269/517] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:53 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:53.402278 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:53.412201 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-85af365e-906c-4ec8-bcb4-f9a47fe68424 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.296825 Aug 29 21:37:53.412857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 249/518] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:53 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:53.879924 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:53.881178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:53.890489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.891761 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.892427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:53.893761 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:53.894748 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:53.898505 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.130512 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.141907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.143357 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.144836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bdb3666b-7915-4b86-880d-e809f8d69c8f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.269330 Aug 29 21:37:54.145389 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 270/519] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:53 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:54.409758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:54.410397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:54.417495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.418002 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.418476 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.419215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.419764 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.420190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.436318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:54.437125 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:54.451714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.452311 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.454627 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.455686 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.456166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.456609 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.459790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:54.460724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:54.461352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:54.462054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:54.514808 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.524990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4c6104bb-3957-4578-ba8f-fd545d09a907 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.119678 Aug 29 21:37:54.526346 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 250/520] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:54 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:54.674787 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:54.690140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-178e6a28-1501-4b0f-b0bb-a27829020617 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.259190 Aug 29 21:37:54.690833 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 271/521] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:54 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:55.172566 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:55.173667 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:55.180472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.181198 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.181578 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.184331 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.184890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.185405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.207803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:55.335320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:55.350527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:55.353243 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:55.356036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b9c641bd-771d-41df-82b4-437e6fb7465d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.189311 Aug 29 21:37:55.357054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 251/522] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:55 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:55.547305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:55.547964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:55.555288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.555920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.556244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.557267 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.557726 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.558178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.595250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.595740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.596182 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.596641 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:55.643510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:55.659587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-19b3966b-b36d-43bc-805a-3ab05bef0c02 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.115900 Aug 29 21:37:55.662083 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 272/523] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:55 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:55.720857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:55.722213 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:55.730383 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.731043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.731767 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.732669 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:55.733213 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:55.733644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:55.936499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:55.946985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cea49f2e-0b8c-4875-9a0e-d0667d7df354 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.229990 Aug 29 21:37:55.947577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 252/524] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:55 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:56.386042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:56.388243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:56.395467 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.396046 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.396554 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.397327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.397891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.398562 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.403361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:37:56.574169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:56.586110 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:56.587886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:56.589670 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ba6fa37b-176a-407f-a96e-7d85bf3894d0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.212164 Aug 29 21:37:56.590408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 273/525] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:56 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:56.687734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:56.688976 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:56.720347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.721115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.722292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.723218 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.723760 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.724261 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.773842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.774650 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.775392 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.776447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:56.837634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:56.855340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a19a3f2f-73fb-4d0b-9186-6cc066331529 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.174120 Aug 29 21:37:56.862894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 253/526] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:56 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:56.976582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:56.977526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:56.984085 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.984577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.985014 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:56.985721 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:56.986211 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:56.986650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.156497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.169881 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e34c3ab6-e455-470e-adb0-a313e115dcc4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.197027 Aug 29 21:37:57.170481 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 274/527] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:56 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:57.623786 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:57.624518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:57.631264 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.631871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.632452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.633217 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.633708 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.634169 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.814431 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.826395 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.828237 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.829430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c3ba7bbf-6952-4644-8bdb-d48e573f24ab tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.209991 Aug 29 21:37:57.830154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 254/528] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:57 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:57.879120 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:57.879911 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:57.888029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.888529 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.888964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.889683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.890178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.890729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.926294 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:57.927065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:57.927209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:57.927908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:57.977194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:57.986651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c8da4858-2b8d-4016-ac86-4ba7c0b4eb53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.113440 Aug 29 21:37:57.987561 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 275/529] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:57 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:58.192208 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:58.192742 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:58.199890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.200371 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.200803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.201494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.201976 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.202392 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.356155 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:58.365224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5d4d8648-2e2b-4a0c-90ed-715cbc8603e4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.177250 Aug 29 21:37:58.380791 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 255/530] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:58 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:37:58.860315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:58.860315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:58.866563 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.867056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.867583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:58.868316 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:58.869381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:58.869381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.008338 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:59.008998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:59.015918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.016418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.016856 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.017560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.018046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.018481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.051420 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.056411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.057632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.058481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.059325 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:37:59.066737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.068213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.069662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bbbadf12-ab6e-498c-9ffe-0947fc6ca3dc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.217902 Aug 29 21:37:59.070573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 276/531] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:37:58 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:37:59.111495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.120505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a8772736-1790-49ae-9f3a-40a190ce7266 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.115541 Aug 29 21:37:59.121325 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 256/532] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:59 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:37:59.393520 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:37:59.394673 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:37:59.406039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.407026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.407982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.409380 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:37:59.410965 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:37:59.410965 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:37:59.566119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:37:59.577579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-63e092d4-e84a-462f-92b5-4ea99e90febc tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.192483 Aug 29 21:37:59.578706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 277/533] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:37:59 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:00.095112 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:00.095765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:00.102491 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.102978 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.103411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.104153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.104600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.105151 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.142380 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:00.143760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:00.147496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:00.153184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.153815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.154267 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.154981 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.155434 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.155999 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.193964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.194468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.194912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.195383 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:00.253544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.262593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2677d132-f674-487d-9791-f04103dcd4a6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.123969 Aug 29 21:38:00.263177 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 278/534] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:00 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:00.294045 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.306283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.310275 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.311786 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8adff70f-a78e-4669-9d82-aa45b2b7439c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.220659 Aug 29 21:38:00.312158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 257/535] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:00 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:00.600345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:00.600954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:00.607621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.608108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.608554 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.609250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:00.609816 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:00.610158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:00.749945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:00.758945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d4b0257f-a58d-48c8-a6be-3e14af74d1d3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.162440 Aug 29 21:38:00.759773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 279/536] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:00 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:01.284605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:01.285218 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:01.292531 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.293019 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.293459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.294193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.294657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.295086 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.331763 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.332268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.332712 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.333594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:01.340557 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:01.341473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:01.351049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.351558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.352059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.352825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.353542 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.354666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.380544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:01.390067 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e1799b9d-ac03-4217-bee3-04e2cd77f132 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.109212 Aug 29 21:38:01.391403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 258/537] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:01 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:01.524025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:01.533869 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:01.535792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:01.536769 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-927c268f-7b46-491b-815d-f03485b3804e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.204615 Aug 29 21:38:01.537541 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 280/538] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:01 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:01.781981 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:01.782745 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:01.789237 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.789906 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.790349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.791724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:01.794580 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:01.795097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:01.949367 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:01.959049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0ad1ca5c-a17e-43b9-89e0-863f99fdb368 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.181012 Aug 29 21:38:01.959639 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 259/539] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:01 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:02.414830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:02.415528 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:02.422473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.422986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.423415 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.424117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.424624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.425042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.458927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.459407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.459832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.460272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:02.503330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:02.511700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-12122163-2cba-4499-a2c6-83a2aec4614e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.102393 Aug 29 21:38:02.512456 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 281/540] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:02 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:02.561348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:02.561997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:02.568822 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.569315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.569804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.570478 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.570908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.571331 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.723990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:02.733313 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:02.734903 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:02.736092 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f38688e7-cbcd-4fe2-9471-ff7acdbd80e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.179385 Aug 29 21:38:02.736637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 260/541] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:02 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:02.984406 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:02.985395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:02.992429 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.992992 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.993443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:02.994848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:02.995506 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:02.995943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.145490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.160486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cb1b26a8-18ef-424a-9f97-6785d4d669eb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.176959 Aug 29 21:38:03.160486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 282/542] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:02 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:03.538061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:03.539135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:03.551751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.552788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.553658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.555079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.556286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.558072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.629064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.629965 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.630775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.631615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:03.689642 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.699780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f7763ee0-efde-449e-b469-5c62537ab92a tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.169516 Aug 29 21:38:03.700396 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 261/543] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:03 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:03.763344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:03.763983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:03.771119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.771600 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.772035 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.772747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:03.773198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:03.773639 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:03.935256 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.944720 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.946290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:03.947468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d5a1ed4f-5851-4525-a0a3-4459f2a7830c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.190123 Aug 29 21:38:03.948265 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 283/544] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:03 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:38:04.186324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:04.187384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:04.200552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.201416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.202233 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.203301 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.203975 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.204406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.344192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:04.353076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-610a5efa-2fff-4a74-b06b-5a19167cd46a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.173152 Aug 29 21:38:04.354393 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 262/545] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:04 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:04.723088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:04.723714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:04.730533 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.731014 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.731442 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.732137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.732584 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.733147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.768078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.768778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.768960 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.769394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:04.813246 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:04.821320 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-84d59736-7d75-419e-8a35-5c9660dba1c7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.102417 Aug 29 21:38:04.822151 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 284/546] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:04 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:04.971661 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:04.972406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:04.980314 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.980842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.982004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:04.982719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:04.983318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:04.983771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.131748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:05.142291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:05.143813 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:05.145014 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1c6819dc-36ea-4e2e-8490-abcdff4b0158 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.177472 Aug 29 21:38:05.145591 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 263/547] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:04 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:05.374858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:05.375528 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:05.381705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.382255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.382687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.383381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.383827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.384253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.529774 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:05.538199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4eca36ac-738e-419f-a588-74f0e48180da tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.167285 Aug 29 21:38:05.538768 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 285/548] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:05 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:05.843925 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:05.844653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:05.850895 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.851374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.851914 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.852609 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.853059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.854215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.887971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:05.888759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:05.889215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:05.889734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid d85c8e78-15e9-492f-b705-c725ff867ed0 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:05.946734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:05.955676 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7abc8b9d-5ea2-4430-92a8-bb4fff7d0f2d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 200 len: 1332 microversion: 2.1 time: 0.115664 Aug 29 21:38:05.956247 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 264/549] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:05 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:06.170670 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:06.171239 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:06.178130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.178613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.179049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.179747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.180193 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.180621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.331019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:06.340282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:06.341731 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:06.342919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-35c3f7f4-5127-4c0c-b341-9f47d55bed00 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.177141 Aug 29 21:38:06.343469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 286/550] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:06 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:38:06.562449 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:06.563231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:06.570276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.570907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.571433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.573252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.574029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.574526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.718875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:06.727402 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-259a0a49-0113-4a4c-97a9-31b1c6428765 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.169564 Aug 29 21:38:06.727986 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 265/551] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:06 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:06.978127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:06.979213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:06.985422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.985943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.986394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:06.987096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:06.987551 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:06.987978 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.002922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 HTTP/1.1 Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:38:07.004593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:38:07.006290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': 'd85c8e78-15e9-492f-b705-c725ff867ed0'} Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:07.007195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:38:07.008613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:07.010590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:07.010590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4038e607-6686-4329-86a5-cec2339000ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 404 len: 111 microversion: 2.1 time: 0.032199 Aug 29 21:38:07.010590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 287/552] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:06 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:38:07.015456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-60d915b9-3245-4927-9334-3ac6c53d93e8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '.version_select at 0x7f8bdf746820>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:07.036285 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-60d915b9-3245-4927-9334-3ac6c53d93e8 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611206824" status: 202 len: 0 microversion: 2.1 time: 0.024498 Aug 29 21:38:07.036878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 266/553] 10.222.0.90 () {58 vars in 1221 bytes} [Mon Aug 29 21:38:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611206824 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:38:07.365695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:07.366392 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:07.373706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.374218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.374653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.375361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.376696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.377130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.620528 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:07.629460 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:07.631136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:07.632362 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fb1c32fd-622b-4bca-a68c-aba5a9f8cf03 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.270709 Aug 29 21:38:07.633081 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 288/554] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:07 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:07.757628 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:07.758278 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:07.764939 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.765419 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.765892 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.766652 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:07.767099 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:07.767526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:07.788896 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:07.829180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e5b5310b-6236-4e4f-a360-ef895882ba54 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: .version_select at 0x7f8bdf7dddc0>, body: {"keypair": {"name": "tempest-keypair-1905922005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7OuvaDu87+tRZlrDrwY7K+pIm3Oixzxv+mxXCuO1+G6RK9WijvxGhnTi0UOMNmraZ/pBtHNLa5uf+HTAK4fS4bS9eMGQHf0mHsWlrcjwvGoxexXjyMyc1TVBty21TDyg=="}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:07.848707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-e5b5310b-6236-4e4f-a360-ef895882ba54 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:38:07.853585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-e5b5310b-6236-4e4f-a360-ef895882ba54 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:38:07.878073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e5b5310b-6236-4e4f-a360-ef895882ba54 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052588 Aug 29 21:38:07.884298 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 289/555] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:38:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:07.912053 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:07.920450 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c73b36ac-f9c3-4759-95df-dc48750972ac tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.167368 Aug 29 21:38:07.921020 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 267/556] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:07 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:08.658451 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:08.659218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:08.667537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.668027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.668465 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.669169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.669989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.670712 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.679271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=100 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:08.862570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:08.872936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:08.874703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:08.876103 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7916fe90-fb0e-4fcc-a283-955702d80df9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.223098 Aug 29 21:38:08.876701 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 290/557] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:08 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:08.942514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:08.943412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:08.950631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.951124 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.951558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:08.952259 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:08.952714 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:08.953135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:09.110951 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:09.121822 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b6f476ee-a9d7-4e5f-afaa-28b9c483f790 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.183079 Aug 29 21:38:09.122448 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 268/558] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:08 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:09.548839 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1633860829", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "377bc5c8-c6c6-472a-a33a-20e9d1f177b1"}], "security_groups": [{"name": "tempest-securitygroup--1304395795"}], "key_name": "tempest-keypair-1905922005", "user_data": "}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:09.651044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] validate_networks() for [('377bc5c8-c6c6-472a-a33a-20e9d1f177b1', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:38:09.900742 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:09.901460 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:09.907470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:09.907962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:09.908401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:09.909096 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:09.909549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:09.910004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.100690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:38:10.101228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:38:10.101577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:38:10.102027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:38:10.102441 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:38:10.111179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.111603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.112017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.112740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.113195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.113619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.113775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:10.123816 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:10.125264 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:10.126456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0e9bc864-a4ac-48be-8385-ace49c7d808d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.230310 Aug 29 21:38:10.127020 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 269/559] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:09 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:38:10.130760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:38:10.135545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:38:10.145582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:10.146411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:10.151752 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:38:10.152465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.152952 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.153387 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.154153 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:10.154605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:10.155024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:10.155351 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:38:10.213235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a304f6f6-4b10-4469-b293-c4bffb49814d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.668652 Aug 29 21:38:10.214278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 291/560] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:38:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:38:10.225266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d87e0dd6-2cf3-4494-982d-080844eb8510 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:10.226313 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d87e0dd6-2cf3-4494-982d-080844eb8510 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:10.302628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d87e0dd6-2cf3-4494-982d-080844eb8510 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:10.310774 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d87e0dd6-2cf3-4494-982d-080844eb8510 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1242 microversion: 2.1 time: 0.089646 Aug 29 21:38:10.311361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 292/561] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:10 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:10.342873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:10.351462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1827bd84-7284-4d07-ac95-241bcb0c22a3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.209741 Aug 29 21:38:10.352042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 270/562] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:10 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:11.152154 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:11.152992 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:11.161937 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.162477 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.162986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.163710 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.164215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.164692 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.333894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:11.334825 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:11.344732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:11.348309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.348817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.349256 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.350580 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.351208 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.351684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.357576 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:11.359052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:11.360226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a4598570-db31-40f7-a5b4-559ba46d8396 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.213432 Aug 29 21:38:11.360773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 293/563] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:11 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:11.377138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:11.380931 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:11.391869 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.392927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.393672 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.394983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:11.396007 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:11.396773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:11.434214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:11.443807 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d879ef84-7c15-45b2-8def-ec3ee33e3d56 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1294 microversion: 2.1 time: 0.114082 Aug 29 21:38:11.444620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 271/564] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:11 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:11.553035 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:11.562634 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c2a15ed3-06b6-44c4-b801-b15745398892 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.189180 Aug 29 21:38:11.563216 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 294/565] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:11 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:12.394842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:12.395829 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:12.402924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.403413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.403852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.404553 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.405010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.405440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.467398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:12.468229 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:12.476605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.477078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.477516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.478268 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.478918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.479352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.568407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:12.579985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f65c7955-88b5-4d72-811f-7da182dcd27f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1294 microversion: 2.1 time: 0.116437 Aug 29 21:38:12.580865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 295/566] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:12 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:12.584384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:12.585581 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:12.586217 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:12.595147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:12.595479 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.595922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.596374 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.596801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:12.597095 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:12.597553 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:12.598028 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-750d62e2-141e-429f-8724-3b5d8a56ee92 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.209818 Aug 29 21:38:12.598207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:12.598702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 272/567] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:12 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:12.750769 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:12.759682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-97cab89f-8d08-47c0-ba2c-93ba9498b7bd tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.177844 Aug 29 21:38:12.760379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 296/568] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:12 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:13.600374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:13.601010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:13.603714 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:13.612260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.613126 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.613925 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.615008 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.615881 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.616528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.622674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:13.623872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:13.631286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.632187 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.633041 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.635294 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.636220 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.636650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.705729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:13.714853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a994fcca-100d-4cb9-b3ac-6531ca9b3ea1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1294 microversion: 2.1 time: 0.118248 Aug 29 21:38:13.715720 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 273/569] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:13 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:13.782802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:13.783573 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:13.789550 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.790068 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.790533 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.791240 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.791901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.792328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.814745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:13.824778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:13.826251 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:13.827476 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1935daf8-7c5a-455d-ba57-1c6b715ea2ff tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.209044 Aug 29 21:38:13.828066 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 297/570] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:13 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:13.971264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:13.973848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:13.981180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.981663 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.982145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:13.982859 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:13.983312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:13.983740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:14.101812 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0ec088ce-5a8b-410b-994e-25b0a8df86fa tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/action" status: 202 len: 0 microversion: 2.1 time: 0.133591 Aug 29 21:38:14.102741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 298/571] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:38:13 2022] POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:38:14.112618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:14.113572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:14.122168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:14.122684 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:14.123130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:14.123839 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:14.124295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:14.124720 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:14.209990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:14.220265 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-26a16c5a-ca3c-4047-a037-bebda79083b4 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.441698 Aug 29 21:38:14.221123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 274/572] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:13 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:14.320343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:14.329227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e68a36cd-67db-47e5-8165-4399da1a061a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1751 microversion: 2.1 time: 0.221359 Aug 29 21:38:14.329827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 299/573] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:14 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:14.735848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:14.736372 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:14.742839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:14.743319 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:14.743962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:14.744938 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:14.745388 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:14.745833 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:14.809750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:14.821294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-77caa7d7-6079-4b2e-9b79-bb17b3f0bec0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1294 microversion: 2.1 time: 0.086636 Aug 29 21:38:14.821294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 275/574] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:14 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:14.853929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:14.854683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:14.861147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:14.861619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:14.862079 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:14.862764 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:14.863207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:14.863622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:15.007672 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:15.017640 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:15.019119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:15.020299 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1cc4b5c8-fcfb-4859-835b-421cc6f2026b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.170917 Aug 29 21:38:15.020891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 300/575] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:14 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:15.250427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:15.250957 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:15.257372 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:15.257905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:15.258346 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:15.259049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:15.259508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:15.259930 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:15.352327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:15.355574 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:15.364702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:15.365352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:15.366179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:15.366949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:15.367340 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:15.367769 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:15.410739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:15.424121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bb931900-f7db-4425-baca-b6071dd6bd93 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.177765 Aug 29 21:38:15.433359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 276/576] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:15 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:15.549698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:15.560376 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c74078a5-3aae-4539-af86-440d6f77c07a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1751 microversion: 2.1 time: 0.212126 Aug 29 21:38:15.561051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 301/577] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:15 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1751 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:15.840450 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:15.841222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:15.848134 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:15.848625 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:15.849063 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:15.849759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:15.850252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:15.850683 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:15.919492 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:15.927659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d6818c40-2c63-43f7-8c29-9aebb9157ffd tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1294 microversion: 2.1 time: 0.091805 Aug 29 21:38:15.933806 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 277/578] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:15 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:16.043119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:16.043716 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:16.050633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.051106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.051534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.052221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.052662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.053080 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.381628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:16.390805 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:16.392363 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:16.393513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c57ccc7b-9acb-41a7-8c25-ce51dadf54e0 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.354398 Aug 29 21:38:16.394129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 302/579] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:16 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:16.448247 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:16.448853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:16.456476 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.456980 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.457464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.458418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.458913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.459336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.583461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:16.584321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:16.590940 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.591705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.592136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.592859 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.593278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.593699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.599059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:16.608670 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6b91f10a-b520-46db-8a91-3f7b19d33d77 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.164375 Aug 29 21:38:16.609436 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 278/580] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:16 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:16.747694 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:16.755995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9254a609-66e9-41a7-8a82-5ddc873142c5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1751 microversion: 2.1 time: 0.176768 Aug 29 21:38:16.756582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 303/581] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:16 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:16.948502 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:16.949114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:16.955587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.956069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.956504 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:16.957182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:16.957984 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:16.958405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.020912 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:17.029498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-13d65da7-37f7-4384-a048-3fab006dbb96 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1312 microversion: 2.1 time: 0.084861 Aug 29 21:38:17.030428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 279/582] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:16 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:17.095938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-465b397f-23c9-48cf-89eb-e167adea5abf req-3d47d361-e306-464c-996a-bd57454cf51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d60cc0-bd66-4d79-a1fc-c673f14f3719", "name": "network-vif-plugged", "status": "completed", "tag": "79623b1d-b179-4248-a2d5-218f0799ca95"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:17.107230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-465b397f-23c9-48cf-89eb-e167adea5abf req-3d47d361-e306-464c-996a-bd57454cf51e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:17.107737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-465b397f-23c9-48cf-89eb-e167adea5abf req-3d47d361-e306-464c-996a-bd57454cf51e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:17.108264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-465b397f-23c9-48cf-89eb-e167adea5abf req-3d47d361-e306-464c-996a-bd57454cf51e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.120112 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-465b397f-23c9-48cf-89eb-e167adea5abf req-3d47d361-e306-464c-996a-bd57454cf51e service nova] Creating event network-vif-plugged:79623b1d-b179-4248-a2d5-218f0799ca95 for instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 on hv-cinder-85426 Aug 29 21:38:17.124912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-465b397f-23c9-48cf-89eb-e167adea5abf req-3d47d361-e306-464c-996a-bd57454cf51e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Aug 29 21:38:17.125510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 304/583] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:17.417484 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:17.418126 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:17.424039 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:17.424521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:17.424959 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.425653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:17.426139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:17.426569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.569895 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:17.579809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:17.581269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:17.582481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1dd6979f-11fe-4bd3-a117-aab55f4fd1f5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.169477 Aug 29 21:38:17.583305 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 280/584] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:17 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:38:17.631605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:17.632358 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:17.639334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:17.639813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:17.640248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.641083 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:17.641530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:17.641974 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.777348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:17.778020 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:17.786010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:17.786590 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:17.787069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.787827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:17.788289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:17.788803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:17.920787 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:17.930500 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3b17e19b-0b46-49d6-b491-40007ccce2c1 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.303755 Aug 29 21:38:17.931308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 305/585] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:17 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:17.996492 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:18.004956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bfef71b5-05dd-4a73-befb-67855e9ebb8b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1751 microversion: 2.1 time: 0.232316 Aug 29 21:38:18.005538 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 281/586] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:17 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:18.050029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:18.050639 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:18.057350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:18.057855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:18.058295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:18.058994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:18.059444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:18.059866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:18.127497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:18.141694 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f9b5614c-01fc-4868-9bae-c0fbd23bbf58 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1300 microversion: 2.1 time: 0.095438 Aug 29 21:38:18.143008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 306/587] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:18 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:18.606304 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:18.607014 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:18.613361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:18.614271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:18.614970 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:18.615900 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:18.616428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:18.616945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:18.866912 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:18.878970 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:18.880440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:18.881612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6aa10719-0398-4db5-adc8-a594eee9226b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.279388 Aug 29 21:38:18.882220 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 282/588] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:18 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:18.952572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:18.953500 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:18.960448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:18.961028 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:18.961564 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:18.962539 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:18.963068 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:18.975533 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.026693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:19.027508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:19.035146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.036066 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.036579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.037401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.038076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.038716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.189430 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:19.198858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-301f24a4-7f16-43d4-9143-8956aa98ff44 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.250087 Aug 29 21:38:19.199435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 307/589] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:18 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:19.204007 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:19.204703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:19.211588 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.212292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.212738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.213613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.214524 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.214524 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.219097 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:19.236244 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:19.246203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-06388b34-1fa1-4b99-a140-766a03017d83 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1751 microversion: 2.1 time: 0.223121 Aug 29 21:38:19.258154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 283/590] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:19 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:19.378963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:19.387654 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e049b4bb-e0d4-4bc3-a42a-e6f89855bbd3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.187151 Aug 29 21:38:19.388227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 308/591] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:19 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:19.629581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:19.630121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:19.637137 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.637642 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.638102 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.638797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.639253 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.639681 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.643733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:19.724811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lazy-loading 'services' on Instance uuid ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:19.807887 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c08f10d1-2a36-46ee-bc0b-986e91c693da tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26/os-volume_attachments/292e666d-011c-45d0-95bc-c95362938313" status: 202 len: 0 microversion: 2.1 time: 0.183870 Aug 29 21:38:19.808707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 284/592] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:38:19 2022] DELETE /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26/os-volume_attachments/292e666d-011c-45d0-95bc-c95362938313 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:38:19.912684 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:19.913760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:19.924365 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.925215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.925811 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:19.926602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:19.926971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:19.927402 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:20.063874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:20.073428 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:20.074929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:20.076112 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-77c4b4e1-9f9d-47ce-9e56-8a6a695ed840 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.170889 Aug 29 21:38:20.076655 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 309/593] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:19 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:20.222492 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:20.223186 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:20.241818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:20.244204 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:20.244811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:20.246030 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:20.246860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:20.247503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:20.269440 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:20.271114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:20.275786 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:20.283645 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:20.284191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:20.284722 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:20.285650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:20.286298 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:20.286830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:20.308391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=12 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:20.592965 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:20.596221 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:20.606390 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b4adf0d4-d5ee-40d1-84c5-56ab6966b982 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1734 microversion: 2.1 time: 0.388977 Aug 29 21:38:20.606755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 285/594] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:20 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1734 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:20.612246 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:20.613076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:20.620275 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5861e925-af49-41eb-9a53-a59ad165ea3c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1751 microversion: 2.1 time: 0.355772 Aug 29 21:38:20.620866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 310/595] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:20 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1751 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:20.624488 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:20.625370 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:20.626426 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:20.627635 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:20.628419 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:20.629131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:20.869625 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:20.878926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a3528423-b25e-4943-ac71-df0a8715a8af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.270733 Aug 29 21:38:20.879806 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 286/596] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:20 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:20.995068 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-6e13dc06-4c5c-4eab-bf24-9016cf856d0f req-47c82225-3a5b-4317-a25b-3553720f5e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1", "tag": "a601e954-9a09-4863-82fb-9c5e708446a5"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:21.001080 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:21.006229 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-6e13dc06-4c5c-4eab-bf24-9016cf856d0f req-47c82225-3a5b-4317-a25b-3553720f5e22 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.006919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-6e13dc06-4c5c-4eab-bf24-9016cf856d0f req-47c82225-3a5b-4317-a25b-3553720f5e22 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.007536 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-6e13dc06-4c5c-4eab-bf24-9016cf856d0f req-47c82225-3a5b-4317-a25b-3553720f5e22 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.019687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-6e13dc06-4c5c-4eab-bf24-9016cf856d0f req-47c82225-3a5b-4317-a25b-3553720f5e22 service nova] Creating event network-changed:a601e954-9a09-4863-82fb-9c5e708446a5 for instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 on hv-cinder-85426 Aug 29 21:38:21.026439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-6e13dc06-4c5c-4eab-bf24-9016cf856d0f req-47c82225-3a5b-4317-a25b-3553720f5e22 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041198 Aug 29 21:38:21.027203 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 311/597] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:21.107336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:21.107949 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:21.114112 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.114522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.114963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.115648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.116101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.116523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.277621 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:21.292492 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:21.294382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:21.295982 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e6318c6e-bd28-4300-b163-c0126d2f5de9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1808 microversion: 2.20 time: 0.193198 Aug 29 21:38:21.297037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 287/598] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:21 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:38:21.639427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:21.640795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:21.643428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:21.644252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:21.648498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.648989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.649436 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.650171 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.650782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.651212 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.652082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.652651 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.653149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.654079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.654608 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.655118 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.856586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:21.866507 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f83a7e73-4ac0-4807-8c90-ef197689ab8c tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1714 microversion: 2.1 time: 0.233374 Aug 29 21:38:21.867085 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 312/599] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:21 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1714 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:21.886755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:21.895778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2cc56083-6016-4f1e-b984-b17678c127f4 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.256618 Aug 29 21:38:21.896382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 288/600] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:21 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:21.912536 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:21.913149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:21.920120 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.920673 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.921387 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.922144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.922597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.923015 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.984317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:21.985061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:21.991870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.992616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.994051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:21.994822 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:21.995287 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:21.995719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.085622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:22.094814 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3d06a049-4f29-4b01-9a3f-3ba9e8927790 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.186126 Aug 29 21:38:22.095375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 313/601] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:21 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:22.105885 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] HTTP exception thrown: Cannot 'detach_volume' instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f while it is in vm_state rescued Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Request method failure captured: Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: DELETE /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments/5a29f46d-6746-4a8c-b3c0-2c37519855a1 HTTP/1.1 Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTC6fe_HCUiyXe_MK1lc6j4kjt8kNPHwscosrHkhpoGn5UfboQOWXEyGKJGIcVvo4m78_Z4Ot-7zS752D_DyN61UBRJ-8iRO94SzJpEiPqun7W4qxVpxz1d_jU8VeOqebGMVqMD4Z9tZPtW8MPOagsT3qzv8y5khHsAuWQRNXjVkIN0 Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:38:22.109107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fb0643eb366140d59f96d86259557915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fb0643eb366140d59f96d86259557915", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 39f161e61a514d94b6008bd006cda5ce Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:38:22.110554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Cannot 'detach_volume' instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f while it is in vm_state rescued Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'server_id': '74dc22ba-7b20-4480-90d8-f249f55b1a6f', 'id': '5a29f46d-6746-4a8c-b3c0-2c37519855a1'} Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:22.111288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f while it is in vm_state rescued Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f while it is in vm_state rescued Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:22.112565 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Returning 409 to user: Cannot 'detach_volume' instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f while it is in vm_state rescued {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:22.113525 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6152fdc6-a06e-481a-b3ea-0c1a52e8f377 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "DELETE /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments/5a29f46d-6746-4a8c-b3c0-2c37519855a1" status: 409 len: 152 microversion: 2.1 time: 0.131384 Aug 29 21:38:22.113525 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 289/602] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:38:21 2022] DELETE /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments/5a29f46d-6746-4a8c-b3c0-2c37519855a1 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 21:38:22.123074 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:22.123610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:22.131039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.131522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.131953 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.132647 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.133121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.133544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.201871 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-36dda8a4-87f6-4f3a-ab40-1760966d5285 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "POST /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/action" status: 202 len: 0 microversion: 2.1 time: 0.083929 Aug 29 21:38:22.202413 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 314/603] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:38:22 2022] POST /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:38:22.210923 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:22.211564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:22.218811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.219300 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.219733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.220418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.220867 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.221315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.327864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:22.328719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:22.335337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.335891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.336394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.338025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.338553 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.339056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.359347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:22.368278 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d79c81b7-de12-4b41-a730-ce59b0de108e tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1722 microversion: 2.1 time: 0.161257 Aug 29 21:38:22.369397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 290/604] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:22 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:22.498596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:22.508188 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:22.510314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:22.511485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3f953fd3-8347-423c-96cf-77e1c5f16dfd tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1795 microversion: 2.20 time: 0.187997 Aug 29 21:38:22.512034 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 315/605] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:38:22 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1795 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:38:22.920450 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:22.921291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:22.929913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.932663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.933420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:22.934241 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:22.934768 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:22.935189 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:23.116929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:23.117565 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:23.124926 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:23.125363 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:23.125835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:23.126537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:23.126989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:23.127414 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:23.654273 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:23.660531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:23.663538 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-dbcbed22-455b-48c0-9f64-5394957905a5 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.749938 Aug 29 21:38:23.667662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 291/606] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:22 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:23.669653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:23.670310 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:23.676189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-188b6f97-ae01-4f59-9dc6-ee05305bae8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.563086 Aug 29 21:38:23.676489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:23.676991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:23.677428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:23.677767 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 316/607] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:23 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:23.678738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:23.679209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:23.679642 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.010951 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:24.022462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-10f16390-d7a3-4209-a5f9-2ac696148378 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1722 microversion: 2.1 time: 0.357363 Aug 29 21:38:24.023149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 292/608] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:23 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:24.156243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:24.157453 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:24.169306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.170184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.171221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.172105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.172865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.173859 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.208112 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:38:24.298534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d1e1da1f-43d9-46a5-8094-856cca8323fc tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 204 len: 0 microversion: 2.1 time: 0.148319 Aug 29 21:38:24.299888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 317/609] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:38:24 2022] DELETE /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:38:24.310405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:24.311022 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:24.319828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.320484 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.320924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.321615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.322093 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.322517 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.468462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:24.476776 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e8836225-8433-4001-9197-ad9324bbcc8c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1512 microversion: 2.1 time: 0.171849 Aug 29 21:38:24.477987 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 293/610] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:24 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:24.686259 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:24.687154 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:24.693130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.693604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.694065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.694761 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.695217 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.695634 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.700095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:24.700712 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:24.706834 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.707317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.708000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.708684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:24.709127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:24.709545 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:24.911734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:24.916596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:24.921965 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-62a48970-102b-411c-b966-377695b436ac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.226231 Aug 29 21:38:24.922755 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 294/611] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:24 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:24.927673 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8edd3552-b35a-412c-a413-e6990004ce0b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.245610 Aug 29 21:38:24.929393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 318/612] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:24 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:25.045441 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:25.046084 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:25.052186 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.052675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.053118 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:25.053941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.054408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.054839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:25.186765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:25.201232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8fe7b5e7-f26b-4d97-9b84-727bd23160d9 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1722 microversion: 2.1 time: 0.159431 Aug 29 21:38:25.202280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 295/613] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:25 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:25.499373 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:25.499952 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:25.507588 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.508062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.509061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:25.509775 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.510436 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.510872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:25.662955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:25.671648 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-46149dd5-0c1b-48cc-81d2-844b80406e58 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1512 microversion: 2.1 time: 0.176195 Aug 29 21:38:25.672229 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 319/614] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:25 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:25.941739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:25.942413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:25.949750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.950274 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.950712 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:25.951405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.951863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.952286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:25.953328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:25.954443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:25.963750 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.964212 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.964641 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:25.965348 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:25.965838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:25.966254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:26.151669 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:26.160044 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-83d990a2-70f8-4091-9cd3-cb6f5bb48f10 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.222059 Aug 29 21:38:26.166259 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 296/615] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:25 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:26.183369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:26.192042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7509643a-5ce6-4a80-b5f2-499c72fd2ecf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.246649 Aug 29 21:38:26.192620 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 320/616] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:25 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:26.226808 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:26.228145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:26.237032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:26.237523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:26.238004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:26.238743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:26.239201 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:26.239658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:26.377918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:26.390897 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-dd1cbc2e-a9a5-4dcd-88f8-da41dcfa7417 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1722 microversion: 2.1 time: 0.169856 Aug 29 21:38:26.391833 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 297/617] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:26 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:26.693709 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:26.694391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:26.701337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:26.701844 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:26.702340 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:26.703023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:26.703454 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:26.703870 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:26.850930 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:26.860439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f7c8c168-bfc6-4ba3-ba6d-8031e745d149 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1512 microversion: 2.1 time: 0.170451 Aug 29 21:38:26.861272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 321/618] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:26 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:27.189859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:27.190477 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:27.197547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.198068 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.198508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:27.199199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.199648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.200075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:27.214159 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:27.214802 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:27.220855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.221385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.221845 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:27.222596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.223103 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.223531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:27.410752 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:27.422195 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c01e2ae1-bddf-4bbe-a404-af08f545b370 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.236009 Aug 29 21:38:27.423653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 298/619] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:27 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:27.429734 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:27.430817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:27.431448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:27.438184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:27.438375 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.438828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.439362 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:27.440273 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.440710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.441139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:27.450012 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b6276371-5644-42e1-8be2-fa8d6e7555c2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.240423 Aug 29 21:38:27.450866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 322/620] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:27 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:27.588430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:27.597051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-eb4e2703-f384-46ca-b62c-583be6d91d8d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1722 microversion: 2.1 time: 0.172294 Aug 29 21:38:27.597642 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 299/621] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:27 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:27.880862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:27.881462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:27.890060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.890546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.891003 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:27.891708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:27.892164 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:27.892587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.045957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:28.054194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-009d370c-afbf-402b-b125-89e979c6cef0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1512 microversion: 2.1 time: 0.177467 Aug 29 21:38:28.055007 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 323/622] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:27 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:28.450652 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:28.451302 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:28.458281 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.458767 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.459206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.459894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.460349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.460776 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.464935 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:28.479399 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:28.480200 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:28.486235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.486721 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.487155 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.487850 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.488300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.488733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.680931 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:28.688870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3e9ff12d-3717-4f28-8ff0-010a0b8289a4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.242106 Aug 29 21:38:28.689453 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 300/623] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:28 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:28.695177 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:28.696066 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:28.697141 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:28.701939 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.702431 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.702862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.703723 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:28.704219 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:28.704637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:28.706135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-43ab8b5b-31fb-43f2-9f1d-712ac0917b13 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.231278 Aug 29 21:38:28.706904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 324/624] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:28 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:28.839401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:28.847979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3141ff6d-43b4-4a38-addd-28efc76de3d7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1722 microversion: 2.1 time: 0.157442 Aug 29 21:38:28.848556 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 301/625] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:28 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:29.087223 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:29.088322 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:29.099172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.100049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.100799 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.102055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.103966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.104765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.291213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:29.301100 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-af8f035b-fa1a-4b27-9661-71e17e9ae09c tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1512 microversion: 2.1 time: 0.218474 Aug 29 21:38:29.302060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 325/626] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:29 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:29.711986 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:29.712807 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:29.719464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.719950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.720392 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.721115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.721572 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.722089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.729310 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:29.730007 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:29.738939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.739425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.739856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.740664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.741191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.741951 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.955110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:29.964016 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c6d8e92a-695d-4df7-94df-e2313041cce3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.257295 Aug 29 21:38:29.964771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 302/627] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:29 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:29.969404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:29.970042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:29.976268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.976748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.977386 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:29.977919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:29.978472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:29.979070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.014308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:30.023228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-201d7f83-7820-44cd-adaa-e303f4ed839e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.299188 Aug 29 21:38:30.023937 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 326/628] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:29 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:30.190727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:30.200254 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f9e42522-6404-4e72-a7e9-09530ad761de tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1722 microversion: 2.1 time: 0.234484 Aug 29 21:38:30.200948 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 303/629] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:29 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:30.329439 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:30.330197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:30.340969 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.341452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.341952 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.342665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.343123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.343550 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.579096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:30.590513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-27a76617-3d84-46db-b427-f3ecb80cf2a0 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1512 microversion: 2.1 time: 0.264641 Aug 29 21:38:30.591480 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 327/630] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:30 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:30.636654 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-70448e1b-ba1f-4579-aebf-8342e009a28a req-64d8ca8c-328c-4499-8ad5-f29daaca67d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26", "name": "network-vif-deleted", "tag": "2d4c1a77-dc4f-4efc-8f52-7085ada3e8db"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:30.646803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-70448e1b-ba1f-4579-aebf-8342e009a28a req-64d8ca8c-328c-4499-8ad5-f29daaca67d2 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:30.647286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-70448e1b-ba1f-4579-aebf-8342e009a28a req-64d8ca8c-328c-4499-8ad5-f29daaca67d2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:30.647719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-70448e1b-ba1f-4579-aebf-8342e009a28a req-64d8ca8c-328c-4499-8ad5-f29daaca67d2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:30.662404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-70448e1b-ba1f-4579-aebf-8342e009a28a req-64d8ca8c-328c-4499-8ad5-f29daaca67d2 service nova] Creating event network-vif-deleted:2d4c1a77-dc4f-4efc-8f52-7085ada3e8db for instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 on hv-cinder-85426 Aug 29 21:38:30.668271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-70448e1b-ba1f-4579-aebf-8342e009a28a req-64d8ca8c-328c-4499-8ad5-f29daaca67d2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036212 Aug 29 21:38:30.668929 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 304/631] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:30.994898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:30.995507 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:31.002440 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.002910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.003547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.004025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.004477 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.004893 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.047738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:31.048555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:31.057005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.057524 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.058055 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.058758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.059209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.059632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.264649 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:31.279073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b2a2c3b5-4a96-423b-a4fe-e70af06aa676 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.289766 Aug 29 21:38:31.280382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 328/632] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:30 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:31.298744 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:31.299639 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:31.311225 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.312804 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.313360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.314698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.315317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.315806 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.325622 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:31.342666 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-447cc9d7-996c-4d10-9eb5-7f0f1fd3d1ef tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.298899 Aug 29 21:38:31.351723 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 305/633] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:31 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:31.415714 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-12b96380-634a-486c-9226-c91072c06995 req-95b0ea66-71df-40db-ad79-93816cdd1bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1", "name": "network-vif-plugged", "status": "completed", "tag": "a601e954-9a09-4863-82fb-9c5e708446a5"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:31.430724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-12b96380-634a-486c-9226-c91072c06995 req-95b0ea66-71df-40db-ad79-93816cdd1bd2 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.431323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-12b96380-634a-486c-9226-c91072c06995 req-95b0ea66-71df-40db-ad79-93816cdd1bd2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.431894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-12b96380-634a-486c-9226-c91072c06995 req-95b0ea66-71df-40db-ad79-93816cdd1bd2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.459620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-12b96380-634a-486c-9226-c91072c06995 req-95b0ea66-71df-40db-ad79-93816cdd1bd2 service nova] Creating event network-vif-plugged:a601e954-9a09-4863-82fb-9c5e708446a5 for instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 on hv-cinder-85426 Aug 29 21:38:31.465907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-12b96380-634a-486c-9226-c91072c06995 req-95b0ea66-71df-40db-ad79-93816cdd1bd2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058698 Aug 29 21:38:31.466514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 306/634] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:31.500191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:31.510925 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-787d996e-c343-4a1b-80e7-f45adef7ad13 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1728 microversion: 2.1 time: 0.228418 Aug 29 21:38:31.511879 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 329/635] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:31 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:31.537639 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:31.538227 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:31.546007 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.546484 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.546917 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.547605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.548049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.548470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.613541 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:31.614203 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:31.620996 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.621495 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.621970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.622683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.623162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.623579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.654750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3c1e1805-487e-4c7f-a891-f083aaf21657 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120988 Aug 29 21:38:31.656543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 307/636] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:38:31 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:38:31.670088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:31.670573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:31.671007 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:31.671461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lazy-loading 'fault' on Instance uuid ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:38:31.716077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '736ad47c636d4172b1a646437ac4feec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bcb7919eee471b8dd0a728fd6255a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:31.724264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cc5bd599-d77c-43ef-9cb5-d7766d7563d2 tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 200 len: 1308 microversion: 2.1 time: 0.115480 Aug 29 21:38:31.724727 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 330/637] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:31 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:32.305882 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:32.306959 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:32.313167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.313660 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.314139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.314839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.315299 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.315728 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.367319 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:32.368847 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:32.375749 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.376403 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.376938 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.377741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.378356 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.379005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.508600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:32.519396 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8bebb3e8-caa2-4716-ac7b-4894167ed347 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.218418 Aug 29 21:38:32.520684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 308/638] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:32 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:32.567602 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:32.580296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f16212d2-c5ff-4d66-8460-255be5084f25 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.216802 Aug 29 21:38:32.581728 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 331/639] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:32 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:32.659961 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-d648c57b-b954-4240-835f-007047f1585e req-2341c683-dcbf-4261-96c3-e8b06fbc52bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dc22ba-7b20-4480-90d8-f249f55b1a6f", "tag": "0ce6a036-6fc5-42b4-831e-99cc480a1ca4"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:32.671394 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-d648c57b-b954-4240-835f-007047f1585e req-2341c683-dcbf-4261-96c3-e8b06fbc52bc service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.671590 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-d648c57b-b954-4240-835f-007047f1585e req-2341c683-dcbf-4261-96c3-e8b06fbc52bc service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.671979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-d648c57b-b954-4240-835f-007047f1585e req-2341c683-dcbf-4261-96c3-e8b06fbc52bc service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.684258 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-d648c57b-b954-4240-835f-007047f1585e req-2341c683-dcbf-4261-96c3-e8b06fbc52bc service nova] Creating event network-changed:0ce6a036-6fc5-42b4-831e-99cc480a1ca4 for instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f on hv-cinder-85426 Aug 29 21:38:32.689271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-d648c57b-b954-4240-835f-007047f1585e req-2341c683-dcbf-4261-96c3-e8b06fbc52bc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033224 Aug 29 21:38:32.690197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 309/640] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:32.746146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:32.746756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] [instance: ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:32.753712 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.754247 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.754659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.755412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:32.755795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:32.756213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:32.771730 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] HTTP exception thrown: Instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 could not be found. Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Request method failure captured: Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 HTTP/1.1 Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTE9kqqhdRojI6DJiohJswkdS5JGjhg2cr5xSEnE0b89_RN48Js_kZXyqEDAuy3YComZT1uTzFWq71KS_nPXW9lCm-Y5dKV1ti8AKF4Ob5J7lPFPapKMN4IO4cpdoDm3RkP_lML4ojL_GK1GpEjdusEL3QwWyom3J_eMGvQetr2McSI Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: f3bcb7919eee471b8dd0a728fd6255a7 Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1488342094 Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:38:32.773378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/f3bcb7919eee471b8dd0a728fd6255a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f3bcb7919eee471b8dd0a728fd6255a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f3bcb7919eee471b8dd0a728fd6255a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_f3bcb7919eee471b8dd0a728fd6255a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-VolumesSnapshotTestJSON-1488342094 Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: f3bcb7919eee471b8dd0a728fd6255a7 Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1488342094 Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-VolumesSnapshotTestJSON-1488342094-project Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 736ad47c636d4172b1a646437ac4feec Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-VolumesSnapshotTestJSON-1488342094-project Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 could not be found. Aug 29 21:38:32.775452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': 'ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26'} Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 could not be found. Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:32.776355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 could not be found. Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 could not be found. Aug 29 21:38:32.777625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:38:32.778820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] Returning 404 to user: Instance ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:32.778820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-34893716-7553-4ae8-a249-812655dc3c4a tempest-VolumesSnapshotTestJSON-1488342094 tempest-VolumesSnapshotTestJSON-1488342094-project] 10.222.0.90 "GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26" status: 404 len: 111 microversion: 2.1 time: 0.033228 Aug 29 21:38:32.778820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 332/641] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:32 2022] GET /compute/v2.1/servers/ffe56a7b-9fd7-45ba-bdaf-efc5b78dce26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:38:33.542224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:33.543189 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:33.551018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.551520 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.551959 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.552669 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.553125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.553814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.605123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:33.605833 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:33.622146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.623405 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.624450 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.625715 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:33.626577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:33.627525 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:33.772812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:33.782314 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cdb37c08-c193-45d5-b5a3-c005dde52825 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1368 microversion: 2.1 time: 0.245630 Aug 29 21:38:33.782906 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 310/642] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:33 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:33.828046 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:33.839572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-24ed369f-6a01-4c4f-9406-3bcecc490626 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.239582 Aug 29 21:38:33.840164 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 333/643] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:33 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:34.707846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-ea950349-a896-4560-8685-8314783a8ee4 req-f7d96c24-9b64-459c-ae8f-befcd2e91f1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dc22ba-7b20-4480-90d8-f249f55b1a6f", "tag": "0ce6a036-6fc5-42b4-831e-99cc480a1ca4"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:34.717526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-ea950349-a896-4560-8685-8314783a8ee4 req-f7d96c24-9b64-459c-ae8f-befcd2e91f1e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.718039 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-ea950349-a896-4560-8685-8314783a8ee4 req-f7d96c24-9b64-459c-ae8f-befcd2e91f1e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.718468 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-ea950349-a896-4560-8685-8314783a8ee4 req-f7d96c24-9b64-459c-ae8f-befcd2e91f1e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.735852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-ea950349-a896-4560-8685-8314783a8ee4 req-f7d96c24-9b64-459c-ae8f-befcd2e91f1e service nova] Creating event network-changed:0ce6a036-6fc5-42b4-831e-99cc480a1ca4 for instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f on hv-cinder-85426 Aug 29 21:38:34.740985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-ea950349-a896-4560-8685-8314783a8ee4 req-f7d96c24-9b64-459c-ae8f-befcd2e91f1e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039670 Aug 29 21:38:34.741595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 311/644] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:34.808514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:34.809127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:34.815803 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.816285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.816751 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.817407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.817884 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.818309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.867842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:34.868785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:34.875852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.876333 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.876770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:34.877460 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:34.878637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:34.879112 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:35.104731 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:35.110620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:35.113097 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7cde483a-9fa7-41db-a4c9-87d5c9d28f80 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1557 microversion: 2.1 time: 0.309513 Aug 29 21:38:35.113682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 334/645] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:34 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1557 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:35.119428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f58163dd-d1b4-46f1-859b-c73a91614cd1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.258101 Aug 29 21:38:35.120002 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 312/646] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:34 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:35.135923 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:35.136417 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:35.142524 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:35.143005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:35.143586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:35.144125 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:35.144572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:35.144980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:35.232342 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d46d4065-b023-4817-a51c-868a4515ebae tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100460 Aug 29 21:38:35.232954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 335/647] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:38:35 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:36.140383 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:36.141072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:36.149333 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:36.149846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:36.150294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:36.151307 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:36.152694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:36.154116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:36.315801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:36.325593 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-be2456a5-5492-44bd-b6af-b4a043b05922 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.188928 Aug 29 21:38:36.326127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 313/648] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:36 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:36.758566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-acdebbc0-b6f9-4f6e-8b39-edc8b90d004d req-aa8d7123-d6ee-4ace-a851-022fbe418c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1", "tag": "a601e954-9a09-4863-82fb-9c5e708446a5"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:36.769207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-acdebbc0-b6f9-4f6e-8b39-edc8b90d004d req-aa8d7123-d6ee-4ace-a851-022fbe418c3e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:36.769823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-acdebbc0-b6f9-4f6e-8b39-edc8b90d004d req-aa8d7123-d6ee-4ace-a851-022fbe418c3e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:36.770331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-acdebbc0-b6f9-4f6e-8b39-edc8b90d004d req-aa8d7123-d6ee-4ace-a851-022fbe418c3e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:36.782956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-acdebbc0-b6f9-4f6e-8b39-edc8b90d004d req-aa8d7123-d6ee-4ace-a851-022fbe418c3e service nova] Creating event network-changed:a601e954-9a09-4863-82fb-9c5e708446a5 for instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 on hv-cinder-85426 Aug 29 21:38:36.788261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-acdebbc0-b6f9-4f6e-8b39-edc8b90d004d req-aa8d7123-d6ee-4ace-a851-022fbe418c3e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034635 Aug 29 21:38:36.788875 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 336/649] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:37.351489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:37.352350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:37.361513 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:37.363770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:37.363770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:37.363770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:37.363770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:37.364544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:37.787380 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:37.799347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d6620981-45a0-490f-9fad-9dccf126d7e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.454346 Aug 29 21:38:37.810429 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 314/650] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:37 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:38.839033 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:38.839719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:38.852558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:38.861770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:38.862890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:38.863939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:38.864641 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:38.865285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:39.026425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:39.034877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-89ed4364-aca1-4ea7-b89e-d1716209b5a1 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.201745 Aug 29 21:38:39.035455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 337/651] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:38 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:40.062243 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:40.062872 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:40.070214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:40.071345 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:40.071787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:40.072498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:40.072949 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:40.073372 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:40.238772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:40.247643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1c3671a5-09fb-4914-9402-d518949443e9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.195004 Aug 29 21:38:40.248222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 315/652] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:40 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:41.271029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:41.271829 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:41.278310 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:41.278839 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:41.279297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:41.280027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:41.280457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:41.280884 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:41.463326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:41.478880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f4cb0c27-a1f5-46b2-8285-32ce9b772f22 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.213103 Aug 29 21:38:41.479957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 338/653] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:41 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:42.501265 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:42.501885 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:42.509091 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:42.509576 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:42.510053 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:42.510743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:42.511197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:42.511624 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:42.675546 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:42.685695 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c1590ded-6541-4913-8ada-32e0567548bb tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.188051 Aug 29 21:38:42.686775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 316/654] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:42 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:43.708786 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:43.709405 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:43.716591 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:43.717181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:43.717771 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:43.718332 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:43.718823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:43.719250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:43.870576 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:43.879059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-478ec7ad-2135-4fad-961e-147263cb89d2 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.174447 Aug 29 21:38:43.879627 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 339/655] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:43 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:44.900944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:44.901935 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:44.904546 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=88 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:44.912695 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:44.913283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:44.913821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:44.915269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:44.915788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:44.916280 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:45.095132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:45.103876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-abc1737a-aa1f-4dac-b53c-d3c3d4c8ab7d tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.207159 Aug 29 21:38:45.104441 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 317/656] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:44 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:46.125714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:46.126270 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:46.133545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.134071 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.134513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.135227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.135693 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.136103 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.303033 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:46.308062 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=100 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:46.314412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b3569044-ff7d-4354-a73f-441dc1ec6312 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1756 microversion: 2.1 time: 0.192582 Aug 29 21:38:46.315012 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 340/657] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:46 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:46.334404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:46.339979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:46.345625 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.346158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.346631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.347349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.347802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.348231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.385354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bdc5700d-93ba-4f6f-81a9-0e45e6163ecb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057344 Aug 29 21:38:46.385858 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 318/658] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:38:46 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:38:46.452359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:46.452856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:46.459198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.459682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.460123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.460881 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.461322 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.461748 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.487983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:38:46.575326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a73eb86c-c71a-4701-b80f-6bc3e7f78667 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 204 len: 0 microversion: 2.1 time: 0.126585 Aug 29 21:38:46.576737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 341/659] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:38:46 2022] DELETE /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:38:46.588526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:46.589146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:46.595233 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.595725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.596169 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.596865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:46.597327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:46.597762 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:46.739850 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:46.744033 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:46.748988 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9888541a-8147-409b-aae5-059d1b85bd93 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1674 microversion: 2.1 time: 0.168009 Aug 29 21:38:46.749573 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 319/660] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:46 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:47.343121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:47.344390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:47.355985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.356879 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.357665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.358986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.359841 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.360643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.530016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:47.538624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-30f0e90b-54ce-4b46-8275-935b19c457e8 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1759 microversion: 2.1 time: 0.203405 Aug 29 21:38:47.539329 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 342/661] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:47 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1759 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:47.775967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:47.776851 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:47.787329 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.788203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.788963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.790087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:47.790814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:47.791349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:47.954616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:47.964855 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-87f02820-21ec-4d39-85fc-894b9a1e45d5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1674 microversion: 2.1 time: 0.197356 Aug 29 21:38:47.965589 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 320/662] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:47 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:48.987027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:48.987784 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:48.995309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:48.995790 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:48.996244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:48.996980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:48.997444 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:48.997923 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:49.182248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:49.191464 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bd5ab395-fa2c-4fcf-aa26-1c5aac46995f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1674 microversion: 2.1 time: 0.208210 Aug 29 21:38:49.192467 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 343/663] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:48 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:50.140687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-81a0f742-6eb0-4535-8fcc-483cecbd57c5 req-00f27aa8-9848-4b26-96fd-62b462fc2379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d", "name": "network-vif-deleted", "tag": "61ca404f-f22e-487f-89c8-418db1d3a29d"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:50.153951 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-81a0f742-6eb0-4535-8fcc-483cecbd57c5 req-00f27aa8-9848-4b26-96fd-62b462fc2379 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:50.154436 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-81a0f742-6eb0-4535-8fcc-483cecbd57c5 req-00f27aa8-9848-4b26-96fd-62b462fc2379 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:50.154862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-81a0f742-6eb0-4535-8fcc-483cecbd57c5 req-00f27aa8-9848-4b26-96fd-62b462fc2379 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:50.173235 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-81a0f742-6eb0-4535-8fcc-483cecbd57c5 req-00f27aa8-9848-4b26-96fd-62b462fc2379 service nova] Creating event network-vif-deleted:61ca404f-f22e-487f-89c8-418db1d3a29d for instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d on hv-cinder-85426 Aug 29 21:38:50.192771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-81a0f742-6eb0-4535-8fcc-483cecbd57c5 req-00f27aa8-9848-4b26-96fd-62b462fc2379 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057722 Aug 29 21:38:50.198707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 321/664] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:50.216901 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:50.217527 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:50.226129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:50.227282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:50.227796 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:50.228597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:50.229141 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:50.229633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:50.331029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:50.349233 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9b1a79d9-a7c5-4723-bff6-0d8693141c39 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 200 len: 1321 microversion: 2.1 time: 0.138965 Aug 29 21:38:50.350261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 344/665] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:50 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 1321 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:51.387423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:51.389847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:51.396362 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:51.397110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:51.397751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:51.399499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:51.400040 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:51.400544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:51.422522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] HTTP exception thrown: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Request method failure captured: Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d HTTP/1.1 Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDApWhyAmKUjbE5wkc6k80Py8uXR_b4HVPTbr-aro-_er8Qnv-DAjW6n0GYYwGgjmfDF7-jgCKZWPvt113398OXOYoc_e51mEX8L5VuIL-dRvmvUG6twZAE_hZysBmfrdnaLawLKmKJ9qrPC-Yk2RPrLKgEcfuJDqac1uPQFYlWNl8 Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:38:51.425037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2847581073e482d8ec3090bcafe93a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: b33a740f1c8a4d9db8d199eff66b76b2 Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:38:51.427964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d'} Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:38:51.430586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:38:51.433168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:38:51.435876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Returning 404 to user: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:38:51.435876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7bedf15e-f052-4540-b4ce-057e08e122f1 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 404 len: 111 microversion: 2.1 time: 0.047596 Aug 29 21:38:51.435876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 322/666] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:51 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:38:51.438238 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dcccc8e3-2b76-4596-b449-03baf498cb3f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '.version_select at 0x7f8bdf88faf0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:51.448053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:38:51.468699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dcccc8e3-2b76-4596-b449-03baf498cb3f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757271228" status: 202 len: 0 microversion: 2.1 time: 0.034576 Aug 29 21:38:51.469699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 345/667] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 21:38:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757271228 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:38:52.533082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2a6e5449-e5c8-4d25-8cdf-ea228c2a4890 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'create', calling method: .version_select at 0x7f8bdf6c6790>, body: {"keypair": {"name": "tempest-keypair-279858710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwX1rD7YHwM9wAlfk5N1DxGh0aw6PJrKHpqQpOowueJctD3FKdmPM21ckDne6bhPiWz85Zw/rdLszXAHfQ/GUxZeMvGVG4fi5PtUJRGaoYeCqMhH46ync9vHaAeAzhGdA=="}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:52.550119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-2a6e5449-e5c8-4d25-8cdf-ea228c2a4890 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for project a2847581073e482d8ec3090bcafe93a7. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:38:52.555071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-2a6e5449-e5c8-4d25-8cdf-ea228c2a4890 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for user b33a740f1c8a4d9db8d199eff66b76b2 and project a2847581073e482d8ec3090bcafe93a7. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:38:52.582446 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2a6e5449-e5c8-4d25-8cdf-ea228c2a4890 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053463 Aug 29 21:38:52.583292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 323/668] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:38:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:54.172862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1116921155", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36675b61-9044-4993-89f1-4d4f8e489fe9"}], "security_groups": [{"name": "tempest-securitygroup--1715646420"}], "key_name": "tempest-keypair-279858710", "user_data": "}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:54.281579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] validate_networks() for [('36675b61-9044-4993-89f1-4d4f8e489fe9', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:38:54.775801 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:38:54.776221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:38:54.776711 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:38:54.777150 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:38:54.780513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:38:54.787603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:54.788008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:54.788785 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:54.789528 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:54.790014 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:54.790479 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:54.808664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for project a2847581073e482d8ec3090bcafe93a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:38:54.814658 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Getting quotas for user b33a740f1c8a4d9db8d199eff66b76b2 and project a2847581073e482d8ec3090bcafe93a7. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:38:54.830543 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:38:54.833416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:38:54.889106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-55781e06-3df6-43b7-bdf6-b9a898fa4193 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.775503 Aug 29 21:38:54.889768 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 346/669] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:38:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:38:54.901572 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f1a4926a-e716-4dbf-bfa4-572935edf685 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:54.902452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f1a4926a-e716-4dbf-bfa4-572935edf685 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:54.967521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f1a4926a-e716-4dbf-bfa4-572935edf685 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:54.975923 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f1a4926a-e716-4dbf-bfa4-572935edf685 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1237 microversion: 2.1 time: 0.079112 Aug 29 21:38:54.976471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 324/670] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:54 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1237 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:56.000154 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:56.000919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:56.010222 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.010711 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.011142 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.011840 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:56.012296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:56.012716 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:56.085296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:56.093860 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3f38c776-6e1f-401b-bf82-80f21ea56d74 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1289 microversion: 2.1 time: 0.098211 Aug 29 21:38:56.094474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 347/671] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:55 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:38:57.120163 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:57.121894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:57.131317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.133046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.134479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.135729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:57.136501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:57.138421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:57.377030 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:57.388917 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d348429a-7595-4fbb-a153-778a040fde95 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1363 microversion: 2.1 time: 0.275677 Aug 29 21:38:57.389842 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 325/672] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:57 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:58.020359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-07c01756-7182-4586-8214-0c5e41c59045 req-e1149559-6839-4a3a-a848-a40c90fefa29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743da6c0-2fa7-4d79-aefb-9ee0ab0ae395", "tag": "77f3c7d4-0437-4863-811c-a218a23efaa8"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:38:58.034473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-07c01756-7182-4586-8214-0c5e41c59045 req-e1149559-6839-4a3a-a848-a40c90fefa29 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.035318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-07c01756-7182-4586-8214-0c5e41c59045 req-e1149559-6839-4a3a-a848-a40c90fefa29 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.036138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-07c01756-7182-4586-8214-0c5e41c59045 req-e1149559-6839-4a3a-a848-a40c90fefa29 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.055452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-07c01756-7182-4586-8214-0c5e41c59045 req-e1149559-6839-4a3a-a848-a40c90fefa29 service nova] Creating event network-changed:77f3c7d4-0437-4863-811c-a218a23efaa8 for instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 on hv-cinder-85426 Aug 29 21:38:58.062000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-07c01756-7182-4586-8214-0c5e41c59045 req-e1149559-6839-4a3a-a848-a40c90fefa29 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048851 Aug 29 21:38:58.063016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 348/673] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:38:58.413373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:58.415725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:58.423635 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.424265 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.424883 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.425738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:58.426423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:58.427007 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:58.704355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:38:58.717406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a3219618-23f4-439c-9258-764914b8c174 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1363 microversion: 2.1 time: 0.308120 Aug 29 21:38:58.718198 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 326/674] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:58 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:38:59.739332 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:38:59.740130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:38:59.748537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.748876 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.751985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.751985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:38:59.751985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:38:59.751985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:38:59.994866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:00.009581 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a44085ea-cf2b-43cd-ad97-80da744d0f21 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1363 microversion: 2.1 time: 0.274639 Aug 29 21:39:00.010701 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 349/675] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:38:59 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:01.041905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:01.042694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:01.049362 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.049877 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.050315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.051058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:01.051553 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:01.051977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:01.201671 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:01.211283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-397f4e51-d0d6-4777-9c9f-54d956871fdc tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1363 microversion: 2.1 time: 0.172950 Aug 29 21:39:01.212116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 327/676] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:01 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:02.232909 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:02.233604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:02.240725 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:02.241201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:02.241668 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:02.242361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:02.242810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:02.243230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:02.402344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:02.410401 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ae78a612-6dc1-4cf4-b773-47261821331c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1363 microversion: 2.1 time: 0.181311 Aug 29 21:39:02.410979 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 350/677] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:02 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:03.397139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-aa080123-01a7-4038-9bd3-689eb2bd30e4 req-4bba218b-da5a-4c71-8584-043978dd273a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743da6c0-2fa7-4d79-aefb-9ee0ab0ae395", "name": "network-vif-plugged", "status": "completed", "tag": "77f3c7d4-0437-4863-811c-a218a23efaa8"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:03.409372 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-aa080123-01a7-4038-9bd3-689eb2bd30e4 req-4bba218b-da5a-4c71-8584-043978dd273a service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:03.409921 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-aa080123-01a7-4038-9bd3-689eb2bd30e4 req-4bba218b-da5a-4c71-8584-043978dd273a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:03.410389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-aa080123-01a7-4038-9bd3-689eb2bd30e4 req-4bba218b-da5a-4c71-8584-043978dd273a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:03.424311 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-aa080123-01a7-4038-9bd3-689eb2bd30e4 req-4bba218b-da5a-4c71-8584-043978dd273a service nova] Creating event network-vif-plugged:77f3c7d4-0437-4863-811c-a218a23efaa8 for instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 on hv-cinder-85426 Aug 29 21:39:03.430717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-aa080123-01a7-4038-9bd3-689eb2bd30e4 req-4bba218b-da5a-4c71-8584-043978dd273a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037865 Aug 29 21:39:03.431239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 328/678] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:03.447173 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:03.448671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:03.463369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:03.464244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:03.465016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:03.466383 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:03.467228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:03.467999 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:03.683642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:03.696159 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f891bfa1-8047-45a7-9e15-19ff9f0f4dd3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1363 microversion: 2.1 time: 0.257709 Aug 29 21:39:03.697106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 351/679] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:03 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:04.719959 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:04.720609 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:04.727447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.727927 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.728359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.729046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:04.729495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:04.729944 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:04.874738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:04.886848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-348e9682-8957-481f-97af-9d0f21473ddb tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1363 microversion: 2.1 time: 0.171493 Aug 29 21:39:04.887538 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 329/680] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:04 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:05.911238 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:05.911915 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:05.915054 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:05.915874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:05.922450 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:05.922945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:05.923380 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:05.924077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:05.924527 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:05.924947 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.075026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:06.083446 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d91f1c7f-78e5-4c15-8c04-3ec9b54b720b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1549 microversion: 2.1 time: 0.176165 Aug 29 21:39:06.084024 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 352/681] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:05 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:06.106115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:06.106663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:06.108660 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=6 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:06.114716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.115209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.115652 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.116682 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:06.117149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:06.117588 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:06.198034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-19743399-32e2-4325-a52f-504dd4aa09ee tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095708 Aug 29 21:39:06.198628 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 330/682] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:39:06 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:07.233432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-131a36aa-4812-4428-a18b-ef0cc098f7cd req-dafffcfc-c780-41e1-8374-ccac43698b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743da6c0-2fa7-4d79-aefb-9ee0ab0ae395", "tag": "77f3c7d4-0437-4863-811c-a218a23efaa8"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:07.244116 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-131a36aa-4812-4428-a18b-ef0cc098f7cd req-dafffcfc-c780-41e1-8374-ccac43698b65 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:07.244663 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-131a36aa-4812-4428-a18b-ef0cc098f7cd req-dafffcfc-c780-41e1-8374-ccac43698b65 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:07.245104 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-131a36aa-4812-4428-a18b-ef0cc098f7cd req-dafffcfc-c780-41e1-8374-ccac43698b65 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:07.258132 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-131a36aa-4812-4428-a18b-ef0cc098f7cd req-dafffcfc-c780-41e1-8374-ccac43698b65 service nova] Creating event network-changed:77f3c7d4-0437-4863-811c-a218a23efaa8 for instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 on hv-cinder-85426 Aug 29 21:39:07.264422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-131a36aa-4812-4428-a18b-ef0cc098f7cd req-dafffcfc-c780-41e1-8374-ccac43698b65 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033615 Aug 29 21:39:07.266153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 353/683] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:11.742056 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:39:11.742641 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Mon Aug 29 21:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments/9e3a17ea-9219-4142-9287-b641cd2c9571 (ip 10.222.0.90) !!! Aug 29 21:39:11.746667 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:11.747164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:11.754750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.755225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.755658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.756977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.757437 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.757953 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.794146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-138e93bb-d28c-4362-a0a2-a9403bff2788 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments/9e3a17ea-9219-4142-9287-b641cd2c9571" status: 200 len: 194 microversion: 2.20 time: 0.054207 Aug 29 21:39:11.794831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 331/684] 10.222.0.90 () {60 vars in 1454 bytes} [Mon Aug 29 21:39:11 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments/9e3a17ea-9219-4142-9287-b641cd2c9571 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:39:11.871617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:11.872424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:11.879991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.880681 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.881122 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.881937 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:11.882873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:11.883357 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:11.975714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lazy-loading 'services' on Instance uuid 28d60cc0-bd66-4d79-a1fc-c673f14f3719 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:12.058400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0c5adb7b-db7d-456e-8046-d252a38f1b30 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments/9e3a17ea-9219-4142-9287-b641cd2c9571" status: 202 len: 0 microversion: 2.20 time: 0.192575 Aug 29 21:39:12.058988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 354/685] 10.222.0.90 () {60 vars in 1457 bytes} [Mon Aug 29 21:39:11 2022] DELETE /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments/9e3a17ea-9219-4142-9287-b641cd2c9571 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:12.067821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:12.070665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:12.076961 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.077649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.078145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.078960 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:12.079454 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:12.079974 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:12.120377 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ac01b8a2-91dc-4783-9b5c-6c187c2f0299 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056625 Aug 29 21:39:12.121127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 332/686] 10.222.0.90 () {60 vars in 1343 bytes} [Mon Aug 29 21:39:12 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:39:13.134042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:13.136253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:13.143308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.143777 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.144201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.144891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.145329 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.145743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.178820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-52d29061-88e8-4f3c-a5f3-60db9841c748 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049348 Aug 29 21:39:13.179592 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 355/687] 10.222.0.90 () {60 vars in 1343 bytes} [Mon Aug 29 21:39:13 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:13.247861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:13.248408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:13.254931 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.255422 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.255857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.257176 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.257370 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.257759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.285344 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:13.376065 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9e128c46-bf68-4f45-b242-93e01e72e848 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 204 len: 0 microversion: 2.20 time: 0.131792 Aug 29 21:39:13.376661 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 333/688] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 21:39:13 2022] DELETE /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:39:13.386655 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:13.387260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:13.394438 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.395049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.395582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.396382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:13.397571 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:13.398260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:13.559108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.569390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.570986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:13.572167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e9d5a605-9a0a-45c9-b82f-29ee47a3c681 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.190267 Aug 29 21:39:13.572734 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 356/689] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:13 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:39:14.598429 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:14.599123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:14.606515 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.607002 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.607442 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.608138 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:14.608591 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:14.609014 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:14.788102 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:14.798328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:14.799797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:14.801390 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9c9c50b2-3b9e-47c8-9cdb-1e63f30f16e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1723 microversion: 2.20 time: 0.207037 Aug 29 21:39:14.801541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 334/690] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:14 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:15.830733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:15.831744 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:15.843143 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.843759 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.844549 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:15.845428 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:15.846284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:15.847028 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.215301 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:16.236315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:16.239187 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:16.240788 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8b655be8-26cb-4226-adf1-0bd9dbbb5120 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1655 microversion: 2.20 time: 0.413851 Aug 29 21:39:16.241608 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 357/691] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:15 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1655 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:39:16.529132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-af2db46e-32e4-4347-b13f-5d42fa658674 req-fd22e395-7d0b-461c-b9b7-8e28bd3619b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d60cc0-bd66-4d79-a1fc-c673f14f3719", "name": "network-vif-deleted", "tag": "79623b1d-b179-4248-a2d5-218f0799ca95"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:16.536075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:16.544032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-af2db46e-32e4-4347-b13f-5d42fa658674 req-fd22e395-7d0b-461c-b9b7-8e28bd3619b1 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:16.544918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-af2db46e-32e4-4347-b13f-5d42fa658674 req-fd22e395-7d0b-461c-b9b7-8e28bd3619b1 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:16.545735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-af2db46e-32e4-4347-b13f-5d42fa658674 req-fd22e395-7d0b-461c-b9b7-8e28bd3619b1 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:16.574415 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-af2db46e-32e4-4347-b13f-5d42fa658674 req-fd22e395-7d0b-461c-b9b7-8e28bd3619b1 service nova] Creating event network-vif-deleted:79623b1d-b179-4248-a2d5-218f0799ca95 for instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 on hv-cinder-85426 Aug 29 21:39:16.584034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-af2db46e-32e4-4347-b13f-5d42fa658674 req-fd22e395-7d0b-461c-b9b7-8e28bd3619b1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060369 Aug 29 21:39:16.585832 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 335/692] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:17.265146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:17.265824 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:17.272487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.272975 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.273443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.274184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.274632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.275059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.278020 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:17.312660 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:17.313193 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:17.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:17.314099 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lazy-loading 'fault' on Instance uuid 28d60cc0-bd66-4d79-a1fc-c673f14f3719 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:17.363544 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:17.374642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:17.376274 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:17.377653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dfaecd44-089d-423b-8426-a165f3c2c145 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 200 len: 1371 microversion: 2.20 time: 0.116936 Aug 29 21:39:17.378509 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 358/693] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:17 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:18.404204 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:18.404901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:18.411244 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.411718 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.412184 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.413497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:18.413961 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:18.414384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:18.417054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:18.434103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] HTTP exception thrown: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Request method failure captured: Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 HTTP/1.1 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTEXNtvQ844a-KGn93sePXbfSNoCBZ117LcTpj5lQT3li6RY0StyMWy3_18CxSBFcMnX6mLWcWi794RlJu3YsRd4vKIcGebK15uwHpNvGWQdZQ-OGc7teGojbBNL5PEsh0yZ8kKumgP74UofXMqpsx4wEpXfvnok91Nul7vwqNSnJG8 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:39:18.436336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_817ab3905c8541dc9c2bab51764984d0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: b6a3df8d796e4ae6ac358f103903d427 Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:39:18.438100 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '28d60cc0-bd66-4d79-a1fc-c673f14f3719'} Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:18.439116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:39:18.440503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:18.441664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Returning 404 to user: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:18.441664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-00d7a1e6-e7ba-4f0d-a84c-bb478b0bc372 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 404 len: 111 microversion: 2.20 time: 0.040155 Aug 29 21:39:18.441664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 336/694] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:18 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:39:18.448231 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-559c299b-6638-427e-8813-5327534f9be6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '.version_select at 0x7f8bdf811790>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:18.471006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-559c299b-6638-427e-8813-5327534f9be6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203200048" status: 204 len: 0 microversion: 2.20 time: 0.026643 Aug 29 21:39:18.471595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 359/695] 10.222.0.90 () {60 vars in 1259 bytes} [Mon Aug 29 21:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203200048 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:39:19.215427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c3053a9e-a204-498e-bcfc-dcebd42b1998 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'create', calling method: .version_select at 0x7f8bdf6e6d30>, body: {"keypair": {"name": "tempest-keypair-1046843215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbs5+0XdhCEMzF3L7+u9EUENSEoY0jIqWeHX9cxo7TvYGKdTvQ3h6gJMR5At5vLVz11iEBzupCUO/DsB8agzkPOkVJCA0tAKwqvs0yujxDBj6NNVxLrKoi0Gi5SyPnodQ=="}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:19.231985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-c3053a9e-a204-498e-bcfc-dcebd42b1998 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for project 817ab3905c8541dc9c2bab51764984d0. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:19.236531 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-c3053a9e-a204-498e-bcfc-dcebd42b1998 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for user b6a3df8d796e4ae6ac358f103903d427 and project 817ab3905c8541dc9c2bab51764984d0. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:19.264245 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c3053a9e-a204-498e-bcfc-dcebd42b1998 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053124 Aug 29 21:39:19.264865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 337/696] 10.222.0.90 () {62 vars in 1200 bytes} [Mon Aug 29 21:39:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 21:39:20.428936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:20.429701 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:20.436849 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.437435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.437739 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.438622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.439466 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.439466 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.567052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'services' on Instance uuid 74dc22ba-7b20-4480-90d8-f249f55b1a6f {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:20.673714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c3ece059-75f2-4fa7-83f0-e77f8d65a20b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "DELETE /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments/5a29f46d-6746-4a8c-b3c0-2c37519855a1" status: 202 len: 0 microversion: 2.1 time: 0.249063 Aug 29 21:39:20.674695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 360/697] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:39:20 2022] DELETE /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments/5a29f46d-6746-4a8c-b3c0-2c37519855a1 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:20.687833 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:20.692009 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:20.700361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.701352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.701819 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.702804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:20.703441 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:20.704296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:20.750607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-aa1216e1-4b1f-4b74-9562-6502f58c6294 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070347 Aug 29 21:39:20.751408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 338/698] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:20 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:20.891510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1482489436", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cc1dc57-ce5c-46cc-8752-8e1a426fca2b"}], "security_groups": [{"name": "tempest-securitygroup--1216491044"}], "key_name": "tempest-keypair-1046843215", "user_data": "}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:21.003918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:21.004706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:21.012647 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.013245 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.013753 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.014846 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.015150 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.016213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.051940 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0206ab61-ccf9-4347-a200-f43b9b025396 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/ips" status: 200 len: 149 microversion: 2.1 time: 0.271190 Aug 29 21:39:21.052748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] validate_networks() for [('8cc1dc57-ce5c-46cc-8752-8e1a426fca2b', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:39:21.053021 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 361/699] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:39:20 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/ips => generated 149 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:21.705374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:39:21.706350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:39:21.706629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:39:21.707031 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:39:21.707438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:39:21.718454 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.718933 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.719416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.720105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.720559 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.721094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.739539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for project 817ab3905c8541dc9c2bab51764984d0. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:21.744849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Getting quotas for user b6a3df8d796e4ae6ac358f103903d427 and project 817ab3905c8541dc9c2bab51764984d0. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:21.757489 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:39:21.759887 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:39:21.764843 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:21.767229 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:21.770107 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:21.777525 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.778236 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.779053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.779781 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.780356 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.780746 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.813484 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5403329a-41a1-449a-aec9-87f3549e9ecb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052539 Aug 29 21:39:21.821826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 362/700] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:21 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:39:21.822269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-87c11988-9096-4d8b-8655-7e3667bfce33 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.931797 Aug 29 21:39:21.822269 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 339/701] 10.222.0.90 () {62 vars in 1188 bytes} [Mon Aug 29 21:39:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 21:39:21.829011 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9af6b5c1-ceb9-4b80-906c-e89d3d7f171b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:21.829664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9af6b5c1-ceb9-4b80-906c-e89d3d7f171b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:21.916582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9af6b5c1-ceb9-4b80-906c-e89d3d7f171b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:21.924314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9af6b5c1-ceb9-4b80-906c-e89d3d7f171b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:21.925126 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:21.925568 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9af6b5c1-ceb9-4b80-906c-e89d3d7f171b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:21.925687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:21.926716 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9af6b5c1-ceb9-4b80-906c-e89d3d7f171b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1282 microversion: 2.20 time: 0.102192 Aug 29 21:39:21.927513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 363/702] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:21 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:21.940298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.940298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.940298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.940298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:21.941135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:21.941135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:21.972126 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:22.071011 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1dee3589-2aa1-486c-a945-b1c4379f6f10 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "DELETE /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 204 len: 0 microversion: 2.1 time: 0.149741 Aug 29 21:39:22.071644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 340/703] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:21 2022] DELETE /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:22.084474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:22.085262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:22.093400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.094066 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.094935 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.096138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.096745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.097263 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.259514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:22.268218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-937f063c-e9e8-430c-a7c6-a618caa33b25 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1688 microversion: 2.1 time: 0.190670 Aug 29 21:39:22.284974 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 364/704] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:22 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:22.480563 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffd6aa45-655e-4442-8428-e9276e111d49"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:22.483166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:22.489559 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.490717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.491159 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.491862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.492459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.492884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.950606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:22.951226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:22.957669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.958192 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.958625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:22.959926 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:22.960381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:22.960823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.033856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:23.044409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:23.045862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:23.047065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-47b518bd-24fb-4af0-b407-540eb18adcf4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1286 microversion: 2.20 time: 0.100899 Aug 29 21:39:23.047673 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 365/705] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:22 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:39:23.292497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:23.293114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:23.300220 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:23.300646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:23.301060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.301924 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:23.302379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:23.302918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:23.468248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:23.477963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6eb70424-0c8b-45e8-a4ef-ff0d2814ccb7 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1688 microversion: 2.1 time: 0.189149 Aug 29 21:39:23.479192 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 366/706] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:23 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:24.072898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:24.073564 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:24.080208 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.080686 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.081372 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.082110 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.082559 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.082978 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.147706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:24.156487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:24.157983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:24.159112 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9350e040-255f-47cb-9f4e-c863478390e4 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1286 microversion: 2.20 time: 0.090722 Aug 29 21:39:24.159685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 367/707] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:24 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:39:24.503216 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:24.503940 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:24.511309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.511799 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.512235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.512948 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:24.513408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:24.513965 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:24.665750 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:24.673979 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d49406cd-fa17-4161-9f41-457bfba5347a tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1688 microversion: 2.1 time: 0.175972 Aug 29 21:39:24.674603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 368/708] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:24 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:25.184091 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:25.184767 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:25.191330 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.191815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.192254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.192960 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.193443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.193912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.257912 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:25.266312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:25.267755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:25.268864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-64e680e9-c75a-4366-a8a7-a67efb5e90c7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1286 microversion: 2.20 time: 0.088897 Aug 29 21:39:25.269424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 369/709] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:25 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:39:25.658365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-84b4ce92-0ab9-43f0-ad9f-e0965006525f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.182197 Aug 29 21:39:25.659024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 341/710] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:39:22 2022] POST /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments => generated 194 bytes in 3184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:25.701175 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:25.701916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:25.711828 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.712292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.712847 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.713805 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:25.714016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:25.714386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:25.968083 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:25.978468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-262030c3-1a08-41ae-91dd-8c1b3e9eba6f tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1688 microversion: 2.1 time: 0.284510 Aug 29 21:39:25.979370 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 370/711] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:25 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1688 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:26.299436 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:26.300844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:26.313863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:26.314848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:26.315832 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:26.317195 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:26.318084 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:26.318949 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:26.444647 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:26.453666 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:26.455486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:26.456894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a950cd15-1e2c-4e3f-9c7b-02d1d7af348f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1334 microversion: 2.20 time: 0.166414 Aug 29 21:39:26.457649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 342/712] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:26 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1334 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:27.005702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:27.008262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:27.018918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.019765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.020206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.021078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.021532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.022331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.110386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:27.122709 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-91e88202-8e16-4a3f-921b-d79b9712baba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 200 len: 1620 microversion: 2.1 time: 0.124930 Aug 29 21:39:27.123610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 371/713] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:26 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 1620 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:27.196886 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-70a80e0a-87ed-43d1-9be8-93f923881cc8 req-1f3229a9-1734-4aad-bdaf-8bd1532a87be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dc22ba-7b20-4480-90d8-f249f55b1a6f", "name": "network-vif-deleted", "tag": "0ce6a036-6fc5-42b4-831e-99cc480a1ca4"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:27.208069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-70a80e0a-87ed-43d1-9be8-93f923881cc8 req-1f3229a9-1734-4aad-bdaf-8bd1532a87be service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.208938 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-70a80e0a-87ed-43d1-9be8-93f923881cc8 req-1f3229a9-1734-4aad-bdaf-8bd1532a87be service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.209579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-70a80e0a-87ed-43d1-9be8-93f923881cc8 req-1f3229a9-1734-4aad-bdaf-8bd1532a87be service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.222211 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-70a80e0a-87ed-43d1-9be8-93f923881cc8 req-1f3229a9-1734-4aad-bdaf-8bd1532a87be service nova] Creating event network-vif-deleted:0ce6a036-6fc5-42b4-831e-99cc480a1ca4 for instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f on hv-cinder-85426 Aug 29 21:39:27.228266 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-70a80e0a-87ed-43d1-9be8-93f923881cc8 req-1f3229a9-1734-4aad-bdaf-8bd1532a87be service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159930 Aug 29 21:39:27.229507 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 343/714] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:27.489400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:27.490036 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:27.497366 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.497883 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.498318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.499017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:27.499462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:27.500101 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:27.734013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:27.744898 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:27.746393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:27.748275 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-49add1a1-78e8-4637-adc3-f53d71cac8eb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1340 microversion: 2.20 time: 0.263725 Aug 29 21:39:27.749264 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 372/715] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:27 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1340 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:28.147787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:28.148971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 74dc22ba-7b20-4480-90d8-f249f55b1a6f] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:28.155481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.155987 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.156445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:28.157120 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.157775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.158232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:28.174126 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] HTTP exception thrown: Instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f could not be found. Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Request method failure captured: Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f HTTP/1.1 Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTC6fe_HCUiyXe_MK1lc6j4kjt8kNPHwscosrHkhpoGn5UfboQOWXEyGKJGIcVvo4m78_Z4Ot-7zS752D_DyN61UBRJ-8iRO94SzJpEiPqun7W4qxVpxz1d_jU8VeOqebGMVqMD4Z9tZPtW8MPOagsT3qzv8y5khHsAuWQRNXjVkIN0 Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:39:28.175781 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fb0643eb366140d59f96d86259557915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fb0643eb366140d59f96d86259557915", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 39f161e61a514d94b6008bd006cda5ce Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f could not be found. Aug 29 21:39:28.177932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '74dc22ba-7b20-4480-90d8-f249f55b1a6f'} Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f could not be found. Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:28.180036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f could not be found. Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f could not be found. Aug 29 21:39:28.183724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:28.186309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Returning 404 to user: Instance 74dc22ba-7b20-4480-90d8-f249f55b1a6f could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:28.186309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ce143e99-fae1-4708-8c3b-2aef71506470 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f" status: 404 len: 111 microversion: 2.1 time: 0.034649 Aug 29 21:39:28.186666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c803a5af-480a-4542-93d2-69af752fd522 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '.version_select at 0x7f8bdf7cbdc0>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:28.191034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 344/716] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:28 2022] GET /compute/v2.1/servers/74dc22ba-7b20-4480-90d8-f249f55b1a6f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:39:28.219603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c803a5af-480a-4542-93d2-69af752fd522 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66272072" status: 202 len: 0 microversion: 2.1 time: 0.035308 Aug 29 21:39:28.222059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 373/717] 10.222.0.90 () {58 vars in 1215 bytes} [Mon Aug 29 21:39:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66272072 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:28.777706 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:28.779030 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:28.785474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.786464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.787114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:28.788346 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:28.789109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:28.789747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:29.053751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.065054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.068848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:29.068848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f4371c4d-9920-416f-ab0d-f669f7c58b29 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1408 microversion: 2.20 time: 0.294848 Aug 29 21:39:29.068848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 345/718] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:28 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:29.249202 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-7f768dca-a4a2-441b-88a3-1bb1cdf3f9e6 req-78719938-3660-4081-ba91-201fa9f1d7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc41e68-4172-413f-bb4f-08e5b1bc1b70", "tag": "84e78a81-6684-42c4-bd59-4c45cc70b49e"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:29.260476 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7f768dca-a4a2-441b-88a3-1bb1cdf3f9e6 req-78719938-3660-4081-ba91-201fa9f1d7e4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:29.260955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7f768dca-a4a2-441b-88a3-1bb1cdf3f9e6 req-78719938-3660-4081-ba91-201fa9f1d7e4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:29.261392 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7f768dca-a4a2-441b-88a3-1bb1cdf3f9e6 req-78719938-3660-4081-ba91-201fa9f1d7e4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:29.272923 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-7f768dca-a4a2-441b-88a3-1bb1cdf3f9e6 req-78719938-3660-4081-ba91-201fa9f1d7e4 service nova] Creating event network-changed:84e78a81-6684-42c4-bd59-4c45cc70b49e for instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 on hv-cinder-85426 Aug 29 21:39:29.278180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-7f768dca-a4a2-441b-88a3-1bb1cdf3f9e6 req-78719938-3660-4081-ba91-201fa9f1d7e4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034025 Aug 29 21:39:29.278788 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 374/719] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:30.093403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:30.094334 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:30.101699 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.102296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.102818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.103785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:30.104337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:30.104920 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:30.300780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.310216 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.311662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:30.312772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1bae2cb5-b454-4e94-9722-9140b51ef762 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1408 microversion: 2.20 time: 0.224779 Aug 29 21:39:30.313356 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 346/720] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:30 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:31.051102 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2131347049"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:31.051824 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.058662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.059228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.059714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.060454 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.060940 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.061485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.201672 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.network.security_group_api [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Removing security group 14178fc8-477d-45b5-abe2-0923aa94d89f from port 6b29b603-5e32-403d-b02a-7c8b33c0dc37 Aug 29 21:39:31.310733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:31.311967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.318833 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.319851 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.320527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.321481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.322197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.322862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.353549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:31.477564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4e547d6b-4613-4178-bdfe-602a2ea6b086 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "DELETE /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 204 len: 0 microversion: 2.1 time: 0.170154 Aug 29 21:39:31.482332 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 347/721] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:31 2022] DELETE /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:39:31.497005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:31.498508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.509310 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.510364 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.511107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.512424 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.513254 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.513874 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.613579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-85bfbad9-0db8-4033-a62a-8140606b8aee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/action" status: 202 len: 0 microversion: 2.1 time: 0.568585 Aug 29 21:39:31.614240 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 375/722] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:39:31 2022] POST /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:31.620734 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:31.621612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:31.627991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.628993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.629678 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.630923 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.632682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.633517 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.729185 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:31.751848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=10 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:31.862049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:31.871207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:31.872633 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:31.873746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c150c673-dc99-4c0e-8678-71e0b1309c22 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1408 microversion: 2.20 time: 0.389441 Aug 29 21:39:31.874521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 348/723] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:31 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:31.877127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:31.879785 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-810ebda6-7711-4429-b2ca-b3fe6ae168ed req-10bcd419-1909-4c26-94cb-326b40950726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05755de8-1f0b-44f4-b4b5-028155749387", "tag": "6b29b603-5e32-403d-b02a-7c8b33c0dc37"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:31.885893 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2261319d-30d4-4cd1-8bb7-7becd8504042 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1508 microversion: 2.1 time: 0.270265 Aug 29 21:39:31.886952 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 376/724] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:31 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:31.889234 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-810ebda6-7711-4429-b2ca-b3fe6ae168ed req-10bcd419-1909-4c26-94cb-326b40950726 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:31.889713 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-810ebda6-7711-4429-b2ca-b3fe6ae168ed req-10bcd419-1909-4c26-94cb-326b40950726 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:31.890164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-810ebda6-7711-4429-b2ca-b3fe6ae168ed req-10bcd419-1909-4c26-94cb-326b40950726 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:31.904551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-810ebda6-7711-4429-b2ca-b3fe6ae168ed req-10bcd419-1909-4c26-94cb-326b40950726 service nova] Creating event network-changed:6b29b603-5e32-403d-b02a-7c8b33c0dc37 for instance 05755de8-1f0b-44f4-b4b5-028155749387 on hv-cinder-85426 Aug 29 21:39:31.909643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-810ebda6-7711-4429-b2ca-b3fe6ae168ed req-10bcd419-1909-4c26-94cb-326b40950726 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033896 Aug 29 21:39:31.910287 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 349/725] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:32.900346 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:32.902798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:32.917322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:32.920728 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:32.922455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:32.931524 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:32.932400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:32.933215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:32.933649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:32.934241 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:32.934519 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:32.934817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:32.935234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:32.935643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:32.935872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:32.936238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:32.936757 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.155572 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:33.157130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:33.168308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:33.169981 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:33.171150 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fb361a77-2f0a-4357-8846-ba79fe5c216f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1408 microversion: 2.20 time: 0.278061 Aug 29 21:39:33.171719 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 377/726] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:32 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:33.171882 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1e627aa3-060c-42ab-8d70-71bd4f2fc0ba tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1508 microversion: 2.1 time: 0.263598 Aug 29 21:39:33.176440 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 350/727] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:32 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:33.186488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:33.187359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:33.198523 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.199102 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.199604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.201008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.201008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.201724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.206882 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:33.317345 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-45a12a82-d122-4938-80de-281b4561b8b0 req-7bd00d38-b022-4d19-8632-726f9bed6645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05755de8-1f0b-44f4-b4b5-028155749387", "tag": "6b29b603-5e32-403d-b02a-7c8b33c0dc37"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:33.329552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-45a12a82-d122-4938-80de-281b4561b8b0 req-7bd00d38-b022-4d19-8632-726f9bed6645 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.330338 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lazy-loading 'services' on Instance uuid 05755de8-1f0b-44f4-b4b5-028155749387 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:33.330897 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-45a12a82-d122-4938-80de-281b4561b8b0 req-7bd00d38-b022-4d19-8632-726f9bed6645 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.331540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-45a12a82-d122-4938-80de-281b4561b8b0 req-7bd00d38-b022-4d19-8632-726f9bed6645 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.354326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-45a12a82-d122-4938-80de-281b4561b8b0 req-7bd00d38-b022-4d19-8632-726f9bed6645 service nova] Creating event network-changed:6b29b603-5e32-403d-b02a-7c8b33c0dc37 for instance 05755de8-1f0b-44f4-b4b5-028155749387 on hv-cinder-85426 Aug 29 21:39:33.376544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-45a12a82-d122-4938-80de-281b4561b8b0 req-7bd00d38-b022-4d19-8632-726f9bed6645 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198575 Aug 29 21:39:33.378119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 351/728] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:33.453655 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-14b37ecd-847d-4b83-a204-76d0de521528 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "DELETE /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments/ee43c980-a261-44df-955a-075f6e9b7e6b" status: 202 len: 0 microversion: 2.1 time: 0.280208 Aug 29 21:39:33.454353 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 378/729] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:39:33 2022] DELETE /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments/ee43c980-a261-44df-955a-075f6e9b7e6b => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:33.465801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:33.468780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:33.483772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.484660 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.485522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.486840 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.494417 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.495479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.568197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ccb4534f-7d7f-4c70-b68c-c645105ee966 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106757 Aug 29 21:39:33.570711 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 352/730] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:33 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:33.747499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-a726cbbe-288c-4530-8db4-4d90db13ce20 req-d9ef4a76-2d32-4013-8a4c-aa37cccc94a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc41e68-4172-413f-bb4f-08e5b1bc1b70", "name": "network-vif-plugged", "status": "completed", "tag": "84e78a81-6684-42c4-bd59-4c45cc70b49e"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:33.760549 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-a726cbbe-288c-4530-8db4-4d90db13ce20 req-d9ef4a76-2d32-4013-8a4c-aa37cccc94a9 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:33.761038 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-a726cbbe-288c-4530-8db4-4d90db13ce20 req-d9ef4a76-2d32-4013-8a4c-aa37cccc94a9 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:33.761677 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-a726cbbe-288c-4530-8db4-4d90db13ce20 req-d9ef4a76-2d32-4013-8a4c-aa37cccc94a9 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:33.775967 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-a726cbbe-288c-4530-8db4-4d90db13ce20 req-d9ef4a76-2d32-4013-8a4c-aa37cccc94a9 service nova] Creating event network-vif-plugged:84e78a81-6684-42c4-bd59-4c45cc70b49e for instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 on hv-cinder-85426 Aug 29 21:39:33.781321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-a726cbbe-288c-4530-8db4-4d90db13ce20 req-d9ef4a76-2d32-4013-8a4c-aa37cccc94a9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128271 Aug 29 21:39:33.781886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 379/731] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:34.196361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:34.197715 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.218921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:34.220053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.226913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.227415 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.227853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.234954 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.235877 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.236657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.249189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.249696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.250274 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.250874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.258577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.261347 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.314172 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:34.508930 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.517295 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7d3f4ab2-579c-4481-8577-103ac315aa76 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1466 microversion: 2.1 time: 0.310287 Aug 29 21:39:34.518101 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 380/732] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:34 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1466 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:34.523844 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-64c7d9e1-1950-46cb-bc6a-d48c87938707 req-152242f9-80fa-40bc-bf7b-e9341332684b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e39fe9-0de6-4578-b311-5a3a0b68b4bb", "name": "network-vif-deleted", "tag": "1f9fa908-44cc-46c6-859f-62b67ba01880"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:34.540971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-64c7d9e1-1950-46cb-bc6a-d48c87938707 req-152242f9-80fa-40bc-bf7b-e9341332684b service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.541720 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-64c7d9e1-1950-46cb-bc6a-d48c87938707 req-152242f9-80fa-40bc-bf7b-e9341332684b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.542176 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-64c7d9e1-1950-46cb-bc6a-d48c87938707 req-152242f9-80fa-40bc-bf7b-e9341332684b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.555854 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-64c7d9e1-1950-46cb-bc6a-d48c87938707 req-152242f9-80fa-40bc-bf7b-e9341332684b service nova] Creating event network-vif-deleted:1f9fa908-44cc-46c6-859f-62b67ba01880 for instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb on hv-cinder-85426 Aug 29 21:39:34.564927 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.581514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-64c7d9e1-1950-46cb-bc6a-d48c87938707 req-152242f9-80fa-40bc-bf7b-e9341332684b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060760 Aug 29 21:39:34.583135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.585892 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:34.586382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 381/733] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:34.593377 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7b47434e-bfb2-4189-99ac-27dd9037e6bb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1408 microversion: 2.20 time: 0.402327 Aug 29 21:39:34.593980 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 353/734] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:34 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:34.596081 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffd6aa45-655e-4442-8428-e9276e111d49"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:34.601192 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.617354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:34.624299 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.630448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.639663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.643090 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.643826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.644810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.645644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.646321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.646596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.647713 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.648630 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.649254 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.649886 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.722862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-36a561e5-6863-4524-9b67-792464d7076b tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125357 Aug 29 21:39:34.723455 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 354/735] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:34 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:39:34.735555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:34.736320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.747634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.748326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.752517 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.753547 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.754071 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.754510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.790681 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Invalid volume: volume ffd6aa45-655e-4442-8428-e9276e111d49 is already attached to instances: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: POST /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments HTTP/1.1 Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 74 Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:39:34.793005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {"volumeAttachment": {"volumeId": "ffd6aa45-655e-4442-8428-e9276e111d49"}} Aug 29 21:39:34.794890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Invalid volume: volume ffd6aa45-655e-4442-8428-e9276e111d49 is already attached to instances: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'server_id': 'ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1', 'body': {'volumeAttachment': {'volumeId': 'ffd6aa45-655e-4442-8428-e9276e111d49'}}} Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ffd6aa45-655e-4442-8428-e9276e111d49 is already attached to instances: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.797235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ffd6aa45-655e-4442-8428-e9276e111d49 is already attached to instances: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:34.799489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ffd6aa45-655e-4442-8428-e9276e111d49 is already attached to instances: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 400 to user: Invalid volume: volume ffd6aa45-655e-4442-8428-e9276e111d49 is already attached to instances: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2fd00bcc-b361-4c48-9a3b-e90cab725b47 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.205874 Aug 29 21:39:34.800873 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 382/736] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:39:34 2022] POST /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments => generated 174 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:39:34.871802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] HTTP exception thrown: Instance 05755de8-1f0b-44f4-b4b5-028155749387 is not attached to volume ee43c980-a261-44df-955a-075f6e9b7e6b Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Request method failure captured: Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: DELETE /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments/ee43c980-a261-44df-955a-075f6e9b7e6b HTTP/1.1 Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTFdwkYOoTPiu54RQA1SgSibnOc88j2fcZPhKKG1v6MJhCyOFo5voQmUqFSf3w2Jm3SprAlI7Y5VadRx8YHVQ4W3lkKgaA1DMjiCghZeZgDi2KNFJCqy3VCMmIkIFkpNxv_-b2y2CLURaenKC33f0IdA7vuUl_BKzhDbws24r9hIiWI Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: df74318c1e404179bbb8533b5909deb8 Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-TestMinimumBasicScenario-854446984 Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:39:34.874369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/df74318c1e404179bbb8533b5909deb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df74318c1e404179bbb8533b5909deb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df74318c1e404179bbb8533b5909deb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_df74318c1e404179bbb8533b5909deb8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-TestMinimumBasicScenario-854446984 Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: df74318c1e404179bbb8533b5909deb8 Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-TestMinimumBasicScenario-854446984 Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-TestMinimumBasicScenario-854446984-project Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: fdba2832a619433eb7e607bb8bf45c59 Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-TestMinimumBasicScenario-854446984-project Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:39:34.876046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 05755de8-1f0b-44f4-b4b5-028155749387 is not attached to volume ee43c980-a261-44df-955a-075f6e9b7e6b Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'server_id': '05755de8-1f0b-44f4-b4b5-028155749387', 'id': 'ee43c980-a261-44df-955a-075f6e9b7e6b'} Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ee43c980-a261-44df-955a-075f6e9b7e6b. Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:34.876847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05755de8-1f0b-44f4-b4b5-028155749387 is not attached to volume ee43c980-a261-44df-955a-075f6e9b7e6b Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05755de8-1f0b-44f4-b4b5-028155749387 is not attached to volume ee43c980-a261-44df-955a-075f6e9b7e6b Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:34.878289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Returning 404 to user: Instance 05755de8-1f0b-44f4-b4b5-028155749387 is not attached to volume ee43c980-a261-44df-955a-075f6e9b7e6b {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:34.879427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a4fccf20-a412-4465-9895-50634de2a030 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "DELETE /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments/ee43c980-a261-44df-955a-075f6e9b7e6b" status: 404 len: 154 microversion: 2.1 time: 0.146063 Aug 29 21:39:34.879427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 355/737] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:39:34 2022] DELETE /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387/os-volume_attachments/ee43c980-a261-44df-955a-075f6e9b7e6b => generated 154 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:39:34.884756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:34.885252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:34.891909 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.892384 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.892681 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.893307 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:34.893754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:34.894202 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:34.993576 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'services' on Instance uuid ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:35.070621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-63a19c07-7740-424b-852e-dfcb60ac9758 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments/ffd6aa45-655e-4442-8428-e9276e111d49" status: 202 len: 0 microversion: 2.1 time: 0.190459 Aug 29 21:39:35.072344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 383/738] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:39:34 2022] DELETE /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments/ffd6aa45-655e-4442-8428-e9276e111d49 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:35.081769 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:35.084479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:35.090657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.091241 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.091745 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.092480 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.092936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.093365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.134467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3fe1c19e-b9bf-432b-86c1-6e522722bba0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056911 Aug 29 21:39:35.135828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 356/739] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:35 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:35.542118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:35.542800 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:35.549173 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.549660 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.550126 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.550823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.551279 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.551707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.586590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.586975 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.587411 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.587859 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'fault' on Instance uuid 19e39fe9-0de6-4578-b311-5a3a0b68b4bb {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:35.618681 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:35.619571 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:35.626406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.627004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.627838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.628637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:35.629322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:35.629882 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:35.633373 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.649039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-babba8ff-960d-477b-9fe2-74da5f16c452 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1312 microversion: 2.1 time: 0.112337 Aug 29 21:39:35.649834 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 384/740] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:35 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:35.793384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.802404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.803943 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:35.805439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-771f3947-fab4-437c-88e1-8c691609f755 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1408 microversion: 2.20 time: 0.190982 Aug 29 21:39:35.805737 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 357/741] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:35 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:39:36.039465 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.039967 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.046344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.046829 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.047265 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.047958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.048407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.048828 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.077555 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:36.150521 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.153418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.163874 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.166320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.167417 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.168245 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.168782 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.169750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.187000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4a03833b-5f23-4d7d-9191-be1c8eb40767 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "DELETE /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 204 len: 0 microversion: 2.1 time: 0.151124 Aug 29 21:39:36.187583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 385/742] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:36 2022] DELETE /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:36.196989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.198081 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.208137 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-22f91c01-c262-4562-a479-307bc45168f7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063090 Aug 29 21:39:36.208727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 358/743] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:36 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:36.213316 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.214249 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.215093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.216362 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.217221 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.218052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.397168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:36.406240 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bf0c6765-d1c5-4bc2-ab75-c3dcd7261eaf tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1554 microversion: 2.1 time: 0.213998 Aug 29 21:39:36.406826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 386/744] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:36 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:36.678127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.678732 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.685556 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.686080 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.686524 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.687232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.687687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.688111 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.733549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.736296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.736657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.737128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'fault' on Instance uuid 19e39fe9-0de6-4578-b311-5a3a0b68b4bb {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:36.783590 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:36.792337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9a068b65-6858-48b5-ab17-83808f0fc209 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1312 microversion: 2.1 time: 0.123927 Aug 29 21:39:36.793288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 359/745] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:36 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:36.827936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:36.828593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:36.836359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.836841 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.837283 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:36.838023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:36.838477 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:36.838897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.014768 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.024711 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.026261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.027492 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2fca59a5-0c9a-4b13-bc01-9d7351bb54a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1601 microversion: 2.20 time: 0.203656 Aug 29 21:39:37.028067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 387/746] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:39:36 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1601 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:39:37.050761 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:37.051257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:37.059128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.059629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.060061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.060769 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.061222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.061648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.150369 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-65f5012a-303b-4c63-a407-ec593dd2fdeb tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103111 Aug 29 21:39:37.151309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 360/747] 10.222.0.90 () {60 vars in 1316 bytes} [Mon Aug 29 21:39:37 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:39:37.226205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:37.230247 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:37.240787 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.241682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.242253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.243096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.243671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.244195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.287666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-52b0cdb2-522c-444f-8cc2-407c64343714 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066235 Aug 29 21:39:37.288661 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 388/748] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:37 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:37.437375 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:37.438046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:37.444705 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.445196 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.445637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.446381 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.446922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.447277 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.815667 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:37.816489 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:37.823994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.824480 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.824910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.825606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.826089 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.826507 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.863017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:37.863626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:37.863991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:37.864436 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'fault' on Instance uuid 19e39fe9-0de6-4578-b311-5a3a0b68b4bb {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:37.935357 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.946725 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-adb86b38-b383-4cac-a0b8-ca0c0849a8bf tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 200 len: 1312 microversion: 2.1 time: 0.135092 Aug 29 21:39:37.947313 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 389/749] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:37 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 1312 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:37.970859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:37.979936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c551b9d2-6ccc-4562-ac24-6abc9337818e tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1554 microversion: 2.1 time: 0.546837 Aug 29 21:39:37.980613 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 361/750] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:37 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1554 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:38.302664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:38.305973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:38.324205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:38.324733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:38.325771 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:38.326022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:38.326430 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:38.326852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:38.369683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-26f2629b-0e9f-45cf-bece-43bfef22fbc7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071051 Aug 29 21:39:38.370206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 390/751] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:38 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:38.841994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-74e9bbc4-bd49-4518-b39b-326bc412d39c req-256fafbe-dd9c-4c97-bb15-fbb6d6ad35a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fc41e68-4172-413f-bb4f-08e5b1bc1b70", "tag": "84e78a81-6684-42c4-bd59-4c45cc70b49e"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:38.858467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-74e9bbc4-bd49-4518-b39b-326bc412d39c req-256fafbe-dd9c-4c97-bb15-fbb6d6ad35a7 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:38.859349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-74e9bbc4-bd49-4518-b39b-326bc412d39c req-256fafbe-dd9c-4c97-bb15-fbb6d6ad35a7 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:38.860019 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-74e9bbc4-bd49-4518-b39b-326bc412d39c req-256fafbe-dd9c-4c97-bb15-fbb6d6ad35a7 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:38.874940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-74e9bbc4-bd49-4518-b39b-326bc412d39c req-256fafbe-dd9c-4c97-bb15-fbb6d6ad35a7 service nova] Creating event network-changed:84e78a81-6684-42c4-bd59-4c45cc70b49e for instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 on hv-cinder-85426 Aug 29 21:39:38.880340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-74e9bbc4-bd49-4518-b39b-326bc412d39c req-256fafbe-dd9c-4c97-bb15-fbb6d6ad35a7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042853 Aug 29 21:39:38.881963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 362/752] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:38.973207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:38.973842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 19e39fe9-0de6-4578-b311-5a3a0b68b4bb] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:38.980625 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:38.981111 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:38.981546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:38.982516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:38.982737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:38.983162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:38.998568 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] HTTP exception thrown: Instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb could not be found. Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Request method failure captured: Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb HTTP/1.1 Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTC6fe_HCUiyXe_MK1lc6j4kjt8kNPHwscosrHkhpoGn5UfboQOWXEyGKJGIcVvo4m78_Z4Ot-7zS752D_DyN61UBRJ-8iRO94SzJpEiPqun7W4qxVpxz1d_jU8VeOqebGMVqMD4Z9tZPtW8MPOagsT3qzv8y5khHsAuWQRNXjVkIN0 Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:39:39.000552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fb0643eb366140d59f96d86259557915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fb0643eb366140d59f96d86259557915", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 39f161e61a514d94b6008bd006cda5ce Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb could not be found. Aug 29 21:39:39.003861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '19e39fe9-0de6-4578-b311-5a3a0b68b4bb'} Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb could not be found. Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:39.004862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb could not be found. Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb could not be found. Aug 29 21:39:39.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:39.007910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Returning 404 to user: Instance 19e39fe9-0de6-4578-b311-5a3a0b68b4bb could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:39.007910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0676ed93-6c11-402c-a5c9-122f83be83bb tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb" status: 404 len: 111 microversion: 2.1 time: 0.032990 Aug 29 21:39:39.008640 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:39.009365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:39.016035 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 391/753] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:38 2022] GET /compute/v2.1/servers/19e39fe9-0de6-4578-b311-5a3a0b68b4bb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:39.016974 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.018182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.019898 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.021164 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:39.021703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:39.022232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.022923 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.024608 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.028483 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.028977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.029418 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.030162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.030816 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.031410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.089660 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:39.125070 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:39.208942 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:39.223543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4478ed3f-6dc4-43bb-864a-e58652a19eee tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1512 microversion: 2.1 time: 0.219509 Aug 29 21:39:39.234010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 363/754] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:39 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:39.267394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-afd2ed33-b8c6-4dab-aa7b-8fdcddf175c5 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "DELETE /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 204 len: 0 microversion: 2.1 time: 0.249804 Aug 29 21:39:39.269018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 392/755] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:39 2022] DELETE /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:39.280176 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:39.281399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:39.290044 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.291580 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.292643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.294390 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.295594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.296748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.348259 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-fb8537ec-2ed2-4661-95a4-13a45485bdf8 req-9e6e8435-351e-4dc2-8950-2579734476ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05755de8-1f0b-44f4-b4b5-028155749387", "name": "network-vif-deleted", "tag": "6b29b603-5e32-403d-b02a-7c8b33c0dc37"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:39.359115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-fb8537ec-2ed2-4661-95a4-13a45485bdf8 req-9e6e8435-351e-4dc2-8950-2579734476ea service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.359591 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-fb8537ec-2ed2-4661-95a4-13a45485bdf8 req-9e6e8435-351e-4dc2-8950-2579734476ea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.360018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-fb8537ec-2ed2-4661-95a4-13a45485bdf8 req-9e6e8435-351e-4dc2-8950-2579734476ea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.384452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-fb8537ec-2ed2-4661-95a4-13a45485bdf8 req-9e6e8435-351e-4dc2-8950-2579734476ea service nova] Creating event network-vif-deleted:6b29b603-5e32-403d-b02a-7c8b33c0dc37 for instance 05755de8-1f0b-44f4-b4b5-028155749387 on hv-cinder-85426 Aug 29 21:39:39.389614 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-fb8537ec-2ed2-4661-95a4-13a45485bdf8 req-9e6e8435-351e-4dc2-8950-2579734476ea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045306 Aug 29 21:39:39.390243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 393/756] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:39:39.396841 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:39.399599 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:39.406057 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.406561 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.407013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.407700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.408147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.408566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.442346 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dea2d725-a3e1-4b6a-a4b1-0df282c63b31 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050702 Aug 29 21:39:39.442903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 394/757] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:39:39 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:39:39.469672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:39.478386 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-99cbd035-30c9-42e3-8372-099a5841c88d tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.203898 Aug 29 21:39:39.478967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 364/758] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:39 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:39.511005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:39.511497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:39.517690 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.518215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.518646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.519345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.519795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.520212 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.553739 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:39:39.643621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-25770bd8-1840-408e-ba8d-ee36d60b1958 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 204 len: 0 microversion: 2.1 time: 0.136176 Aug 29 21:39:39.644485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 395/759] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:39:39 2022] DELETE /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:39:39.653599 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:39.654552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:39.657772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:39.664224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.664719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.665156 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.665930 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:39.666390 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:39.666821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:39.808789 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:39.820380 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bd2f61b5-c0cc-4e9b-ac3d-5930eb745eac tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1682 microversion: 2.1 time: 0.169632 Aug 29 21:39:39.820380 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 365/760] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:39 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:40.250540 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:40.251245 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:40.258160 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.258647 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.259115 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.259813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.260268 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.260692 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.327096 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:40.335139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d674c0c7-be73-433d-861d-e9b9b8dd0d10 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1512 microversion: 2.1 time: 0.089094 Aug 29 21:39:40.335703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 396/761] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:40 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1512 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:40.499354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:40.499964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:40.506519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.506998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.507428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.508106 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.508572 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.508991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.645147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:40.652994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8b64f41c-92f7-424d-82c7-a6f2d637aa70 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.157531 Aug 29 21:39:40.653561 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 366/762] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:40 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:40.845409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:40.846521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:40.855455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.855944 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.856383 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.857091 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:40.857545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:40.858003 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:40.994770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:41.002597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-64f89958-c3f8-4904-9327-f59493864c98 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1682 microversion: 2.1 time: 0.163924 Aug 29 21:39:41.003166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 397/763] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:40 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:41.356493 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:41.357148 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:41.363698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:41.364182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:41.364614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:41.365303 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:41.365754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:41.366202 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:41.444849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:41.460509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5cf1f8e1-88e7-44d2-8819-29728a65a2a7 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1512 microversion: 2.1 time: 0.108065 Aug 29 21:39:41.461474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 367/764] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:41 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:41.673294 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:41.673877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:41.680434 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:41.680918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:41.681351 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:41.682072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:41.682525 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:41.682951 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:41.821107 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:41.829040 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7c269cdc-4715-457a-b6cb-6d344f7255f3 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.159735 Aug 29 21:39:41.829616 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 398/765] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:41 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:42.024352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:42.024884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:42.031795 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.032282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.032716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:42.033428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.033890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.034312 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:42.181541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:42.189552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d1a402da-eb86-46b4-96a8-ebd84584120d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1682 microversion: 2.1 time: 0.169381 Aug 29 21:39:42.190167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 368/766] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:42 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:42.483363 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:42.483976 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:42.486499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:42.492586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.493107 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.493523 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:42.494255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.495472 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.495472 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:42.559358 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:42.567256 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-43739295-9923-4a85-8b68-2e6c6fdde781 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1343 microversion: 2.1 time: 0.087672 Aug 29 21:39:42.567828 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 399/767] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:42 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:42.850129 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:42.850772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:42.857135 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.857622 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.858094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:42.858797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:42.859245 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:42.859670 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.010948 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:43.023679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7869a12f-c086-4f12-8ba2-7d93d929d099 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1521 microversion: 2.1 time: 0.176128 Aug 29 21:39:43.024278 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 369/768] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:42 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:43.213547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:43.215100 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:43.224195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.225277 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.225970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.227229 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.227875 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.228432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.588904 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:43.589936 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:43.597159 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.597549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.598201 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.599775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.600431 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.601009 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.602928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:43.613121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e1ef15b0-f96a-4ad9-9775-a501d2d59673 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1682 microversion: 2.1 time: 0.405684 Aug 29 21:39:43.628575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 400/769] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:43 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1682 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:43.634811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:43.652741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.653152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.653596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.654087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lazy-loading 'fault' on Instance uuid 05755de8-1f0b-44f4-b4b5-028155749387 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:43.713816 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdba2832a619433eb7e607bb8bf45c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df74318c1e404179bbb8533b5909deb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:43.728414 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0d4dc13e-b7fc-4b69-978c-6939d29cba0a tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 200 len: 1348 microversion: 2.1 time: 0.142865 Aug 29 21:39:43.729570 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 370/770] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:43 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 1348 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:43.955732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-917c9fde-cf0c-44cf-bfad-c4959a68136f req-2261394f-c687-4b75-8ff5-1bf35489875c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71714c3b-cd6f-413e-a16b-e97161abd750", "name": "network-vif-deleted", "tag": "bcd222e7-b8b9-4f26-ba2d-337995705322"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:43.973050 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-917c9fde-cf0c-44cf-bfad-c4959a68136f req-2261394f-c687-4b75-8ff5-1bf35489875c service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:43.973561 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-917c9fde-cf0c-44cf-bfad-c4959a68136f req-2261394f-c687-4b75-8ff5-1bf35489875c service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:43.974013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-917c9fde-cf0c-44cf-bfad-c4959a68136f req-2261394f-c687-4b75-8ff5-1bf35489875c service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:43.999791 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-917c9fde-cf0c-44cf-bfad-c4959a68136f req-2261394f-c687-4b75-8ff5-1bf35489875c service nova] Creating event network-vif-deleted:bcd222e7-b8b9-4f26-ba2d-337995705322 for instance 71714c3b-cd6f-413e-a16b-e97161abd750 on hv-cinder-85426 Aug 29 21:39:44.007634 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-917c9fde-cf0c-44cf-bfad-c4959a68136f req-2261394f-c687-4b75-8ff5-1bf35489875c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055820 Aug 29 21:39:44.008915 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 401/771] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:44.045340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:44.046002 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:44.053595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.054544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.055032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.055965 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.056543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.057518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.103185 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.103680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.104404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.105040 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lazy-loading 'fault' on Instance uuid 71714c3b-cd6f-413e-a16b-e97161abd750 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:44.167175 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f161e61a514d94b6008bd006cda5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0643eb366140d59f96d86259557915', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:44.175616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-17a008cb-8c55-4d35-8bf7-b3d27e399e2b tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 200 len: 1311 microversion: 2.1 time: 0.134177 Aug 29 21:39:44.176571 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 371/772] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:44 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:44.640710 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:44.641546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:44.650342 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.650590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.650962 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.651801 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.652285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.652744 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.751870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:44.752676 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] [instance: 05755de8-1f0b-44f4-b4b5-028155749387] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:44.761467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.762176 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.762754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.763579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.764143 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.764679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.782813 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] HTTP exception thrown: Instance 05755de8-1f0b-44f4-b4b5-028155749387 could not be found. Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Request method failure captured: Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 HTTP/1.1 Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTFdwkYOoTPiu54RQA1SgSibnOc88j2fcZPhKKG1v6MJhCyOFo5voQmUqFSf3w2Jm3SprAlI7Y5VadRx8YHVQ4W3lkKgaA1DMjiCghZeZgDi2KNFJCqy3VCMmIkIFkpNxv_-b2y2CLURaenKC33f0IdA7vuUl_BKzhDbws24r9hIiWI Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: df74318c1e404179bbb8533b5909deb8 Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-TestMinimumBasicScenario-854446984 Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:39:44.784849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/df74318c1e404179bbb8533b5909deb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df74318c1e404179bbb8533b5909deb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/df74318c1e404179bbb8533b5909deb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_df74318c1e404179bbb8533b5909deb8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-TestMinimumBasicScenario-854446984 Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: df74318c1e404179bbb8533b5909deb8 Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-TestMinimumBasicScenario-854446984 Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-TestMinimumBasicScenario-854446984-project Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: fdba2832a619433eb7e607bb8bf45c59 Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-TestMinimumBasicScenario-854446984-project Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 05755de8-1f0b-44f4-b4b5-028155749387 could not be found. Aug 29 21:39:44.786544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '05755de8-1f0b-44f4-b4b5-028155749387'} Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05755de8-1f0b-44f4-b4b5-028155749387 could not be found. Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:44.787638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05755de8-1f0b-44f4-b4b5-028155749387 could not be found. Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05755de8-1f0b-44f4-b4b5-028155749387 could not be found. Aug 29 21:39:44.789809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:44.791604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Returning 404 to user: Instance 05755de8-1f0b-44f4-b4b5-028155749387 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:44.791604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3c7ec4cc-6a06-46d5-a6a5-536ad9c0b6c9 tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387" status: 404 len: 111 microversion: 2.1 time: 0.038715 Aug 29 21:39:44.791604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 372/773] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:44 2022] GET /compute/v2.1/servers/05755de8-1f0b-44f4-b4b5-028155749387 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:39:44.795880 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-fd61f068-694c-44e7-8bc2-9ee29eb6dd0c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] Calling method '.version_select at 0x7f8bdf628ee0>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:44.818860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-fd61f068-694c-44e7-8bc2-9ee29eb6dd0c tempest-TestMinimumBasicScenario-854446984 tempest-TestMinimumBasicScenario-854446984-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2078622867" status: 202 len: 0 microversion: 2.1 time: 0.026190 Aug 29 21:39:44.822404 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 373/774] 10.222.0.90 () {58 vars in 1272 bytes} [Mon Aug 29 21:39:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2078622867 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:44.834990 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:44.844810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-78fc0d12-f80c-40ad-88cf-d0803cbe2b8f tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 200 len: 1614 microversion: 2.1 time: 0.211374 Aug 29 21:39:44.848061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 402/775] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:44 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 1614 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:44.904357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-41e2a1dc-1efd-4206-9ec3-9ffc772b7a17 req-a84a3fa3-752b-4013-ace4-140bf6ca6313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1", "name": "network-vif-deleted", "tag": "a601e954-9a09-4863-82fb-9c5e708446a5"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:44.919197 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-41e2a1dc-1efd-4206-9ec3-9ffc772b7a17 req-a84a3fa3-752b-4013-ace4-140bf6ca6313 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:44.919797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-41e2a1dc-1efd-4206-9ec3-9ffc772b7a17 req-a84a3fa3-752b-4013-ace4-140bf6ca6313 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:44.920468 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-41e2a1dc-1efd-4206-9ec3-9ffc772b7a17 req-a84a3fa3-752b-4013-ace4-140bf6ca6313 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:44.937413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-41e2a1dc-1efd-4206-9ec3-9ffc772b7a17 req-a84a3fa3-752b-4013-ace4-140bf6ca6313 service nova] Creating event network-vif-deleted:a601e954-9a09-4863-82fb-9c5e708446a5 for instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 on hv-cinder-85426 Aug 29 21:39:44.943804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-41e2a1dc-1efd-4206-9ec3-9ffc772b7a17 req-a84a3fa3-752b-4013-ace4-140bf6ca6313 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044127 Aug 29 21:39:44.950212 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 374/776] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:45.199023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:45.199904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] [instance: 71714c3b-cd6f-413e-a16b-e97161abd750] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:45.206633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.207117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.207742 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.209703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.210309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.210957 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.227261 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] HTTP exception thrown: Instance 71714c3b-cd6f-413e-a16b-e97161abd750 could not be found. Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Request method failure captured: Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 HTTP/1.1 Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTC6fe_HCUiyXe_MK1lc6j4kjt8kNPHwscosrHkhpoGn5UfboQOWXEyGKJGIcVvo4m78_Z4Ot-7zS752D_DyN61UBRJ-8iRO94SzJpEiPqun7W4qxVpxz1d_jU8VeOqebGMVqMD4Z9tZPtW8MPOagsT3qzv8y5khHsAuWQRNXjVkIN0 Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:39:45.228916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fb0643eb366140d59f96d86259557915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fb0643eb366140d59f96d86259557915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fb0643eb366140d59f96d86259557915", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: fb0643eb366140d59f96d86259557915 Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1951712425 Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 39f161e61a514d94b6008bd006cda5ce Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1951712425-project Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 71714c3b-cd6f-413e-a16b-e97161abd750 could not be found. Aug 29 21:39:45.230285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '71714c3b-cd6f-413e-a16b-e97161abd750'} Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71714c3b-cd6f-413e-a16b-e97161abd750 could not be found. Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:45.231317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71714c3b-cd6f-413e-a16b-e97161abd750 could not be found. Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71714c3b-cd6f-413e-a16b-e97161abd750 could not be found. Aug 29 21:39:45.232807 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.234236 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] Returning 404 to user: Instance 71714c3b-cd6f-413e-a16b-e97161abd750 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:45.234236 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-439fafa4-a5c4-4567-99d5-e6adfcddd234 tempest-ServerRescueNegativeTestJSON-1951712425 tempest-ServerRescueNegativeTestJSON-1951712425-project] 10.222.0.90 "GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750" status: 404 len: 111 microversion: 2.1 time: 0.035273 Aug 29 21:39:45.234236 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 403/777] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:45 2022] GET /compute/v2.1/servers/71714c3b-cd6f-413e-a16b-e97161abd750 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:45.873664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:45.875025 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:45.882452 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.882956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.883397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.884110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:45.884751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:45.886035 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:45.908863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 HTTP/1.1 Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:39:45.910607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:39:45.913168 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1'} Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:39:45.914125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:39:45.915594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:39:45.918694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:39:45.920325 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0183097a-9b73-4ad5-bb20-40fb3a14fc5d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 404 len: 111 microversion: 2.1 time: 0.050753 Aug 29 21:39:45.924663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 375/778] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:45 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:39:45.931600 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f08280ef-c118-43ab-b605-30a149dc34d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '.version_select at 0x7f8bdf78b820>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:45.960121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f08280ef-c118-43ab-b605-30a149dc34d9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905922005" status: 202 len: 0 microversion: 2.1 time: 0.032773 Aug 29 21:39:45.961441 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 404/779] 10.222.0.90 () {58 vars in 1221 bytes} [Mon Aug 29 21:39:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905922005 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:39:47.297011 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2dd60286-7dab-4d35-892f-2106db4dc7a2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: .version_select at 0x7f8bdf628280>, body: {"keypair": {"name": "tempest-keypair-1645324035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZTL8CZPODoPPz089dHFtTgd8nJP0xe651/01pgT3JRwUMwQz2NgVwI/M1DjkO0ulxhISUa4O//dDA0cfmJTmHrjH4ARyKj7sYaaNUkXLX1aKBEHs1EelzeEIjsLUuFOQ=="}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:47.320584 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-2dd60286-7dab-4d35-892f-2106db4dc7a2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:47.326198 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-2dd60286-7dab-4d35-892f-2106db4dc7a2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'key_pairs'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:47.360075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2dd60286-7dab-4d35-892f-2106db4dc7a2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069602 Aug 29 21:39:47.367384 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 376/780] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:39:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:50.550689 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-409369651", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "377bc5c8-c6c6-472a-a33a-20e9d1f177b1"}], "security_groups": [{"name": "tempest-securitygroup--1339282799"}], "key_name": "tempest-keypair-1645324035", "user_data": "}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:50.887596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] validate_networks() for [('377bc5c8-c6c6-472a-a33a-20e9d1f177b1', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:39:50.922511 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:50.923679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:50.953225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:50.954018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:50.955523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:50.956707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:50.958824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:50.958824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:51.005406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e7e69af7-069d-47f9-8c2c-5c496443d0f6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/ips" status: 200 len: 145 microversion: 2.1 time: 0.090789 Aug 29 21:39:51.006494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 377/781] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:39:50 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/ips => generated 145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:51.616266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:39:51.616815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:39:51.617179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:39:51.617597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:39:51.618033 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:39:51.628156 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:51.628648 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:51.629082 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:51.629812 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:51.631367 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:51.631929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:51.651097 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:39:51.655970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Getting quotas for user bbbfb39899b04668ac1b7ff28d18e839 and project d3c829bce41c4be9a0027076ef0ace75. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:39:51.674904 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:39:51.678085 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:39:51.729538 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f876fe77-8b6c-4445-8742-b4f2c314b8f6 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.185357 Aug 29 21:39:51.736385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 405/782] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:39:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:39:51.745068 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3cce0de5-dd11-4a95-8ce7-061f3a3a03af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:51.746209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3cce0de5-dd11-4a95-8ce7-061f3a3a03af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:51.814214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3cce0de5-dd11-4a95-8ce7-061f3a3a03af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:51.823688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3cce0de5-dd11-4a95-8ce7-061f3a3a03af tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1241 microversion: 2.1 time: 0.084660 Aug 29 21:39:51.838318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 378/783] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:51 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:52.570571 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4695b9b4-df12-4879-9dd3-4b7508cf78b0"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:52.574384 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:52.590076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:52.590895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:52.591795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:52.592866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:52.593555 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:52.594254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:52.845925 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:52.846652 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:52.853005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:52.854416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:52.855098 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:52.856005 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:52.856563 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:52.857085 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:52.951501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:52.962990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d314484f-f890-42eb-a65c-fb256d34e833 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1293 microversion: 2.1 time: 0.121796 Aug 29 21:39:52.978080 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 379/784] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:52 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:53.179112 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a27556f5-4a2e-4333-ab0e-b86e5c43ca30 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617098 Aug 29 21:39:53.183531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 406/785] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:39:52 2022] POST /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:53.995848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:54.008549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:54.025486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.026665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.027109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.029674 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:54.031257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:54.034506 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:54.180802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:54.215597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e7407bb0-138c-4ec1-aa58-794fed18cb71 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1299 microversion: 2.1 time: 0.228524 Aug 29 21:39:54.216195 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 380/786] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:53 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:55.232792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-4f77b0e4-3633-41f7-83f7-89d9c0c8caef req-6b42e053-a145-438d-baf8-aaa2adb9a42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79710085-1445-4ccc-b0e8-9eceadb5a956", "tag": "8a9dc579-27fb-4534-8725-09a41e317d71"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:55.252292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:55.253563 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:55.274551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:55.279409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4f77b0e4-3633-41f7-83f7-89d9c0c8caef req-6b42e053-a145-438d-baf8-aaa2adb9a42a service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:55.281237 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:55.283520 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:55.291278 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4f77b0e4-3633-41f7-83f7-89d9c0c8caef req-6b42e053-a145-438d-baf8-aaa2adb9a42a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:55.291936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-4f77b0e4-3633-41f7-83f7-89d9c0c8caef req-6b42e053-a145-438d-baf8-aaa2adb9a42a service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:55.292393 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:55.296447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:55.297166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:55.328893 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-4f77b0e4-3633-41f7-83f7-89d9c0c8caef req-6b42e053-a145-438d-baf8-aaa2adb9a42a service nova] Creating event network-changed:8a9dc579-27fb-4534-8725-09a41e317d71 for instance 79710085-1445-4ccc-b0e8-9eceadb5a956 on hv-cinder-85426 Aug 29 21:39:55.370339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-4f77b0e4-3633-41f7-83f7-89d9c0c8caef req-6b42e053-a145-438d-baf8-aaa2adb9a42a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143804 Aug 29 21:39:55.379805 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 407/787] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:39:55.902308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:55.915264 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e7a77f93-203d-44de-b3d3-33806b24b4ba tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1367 microversion: 2.1 time: 0.667144 Aug 29 21:39:55.916180 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 381/788] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:55 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1367 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:56.937579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:56.939309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:56.947160 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:56.947654 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:56.948092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:56.948893 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:56.949541 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:56.950018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:57.265924 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:57.276958 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a59b0ed3-fa17-4d95-9163-5fd78d771591 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1367 microversion: 2.1 time: 0.343892 Aug 29 21:39:57.277747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 408/789] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:56 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:58.304612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:58.305298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:58.311823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.312290 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.312726 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.313412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:58.313893 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:58.314322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:58.452719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:58.461329 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7beaf317-9830-489a-b2ac-9816be52fd4b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1367 microversion: 2.1 time: 0.160621 Aug 29 21:39:58.461917 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 382/790] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:58 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:39:59.377652 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:39:59.378250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:59.385583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.386167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.386598 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.387286 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.387735 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.388150 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.401871 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:39:59.411722 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lazy-loading 'flavor' on Instance uuid 3819524d-f3cb-4a48-b655-369801192ff1 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:39:59.481979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:59.482711 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:59.486244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ec1d0eb4-bf2d-459f-a0fb-ce9b10f7a99b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "POST /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.112291 Aug 29 21:39:59.486835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 409/791] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:39:59 2022] POST /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:39:59.490019 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.490792 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.491271 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.491991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.492451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.492878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.496410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:39:59.497134 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:39:59.503256 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.503737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.504194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.505758 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:39:59.506282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:39:59.506713 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:39:59.690749 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:59.694908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:39:59.700719 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1cd44272-89e1-45cb-80ad-07cf608a73d0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1367 microversion: 2.1 time: 0.222560 Aug 29 21:39:59.701311 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 383/792] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:59 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:39:59.703685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5cdcc394-179f-44e4-aabf-353e476e3488 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.211464 Aug 29 21:39:59.704256 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 410/793] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:39:59 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:00.725315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:00.726023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:00.726632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:00.727717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:00.732364 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.733056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.733496 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.734268 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.735042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.735701 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.740034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.740526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.740964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.741693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:00.742152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:00.742577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:00.959398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:00.962341 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:00.970551 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b015e4fa-f343-43f8-908d-2fc1dbb3e87a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.248931 Aug 29 21:40:00.972026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 411/794] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:00 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:00.991251 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-fdaa079e-fbba-4e8f-a16a-d519e5df5a77 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1367 microversion: 2.1 time: 0.271686 Aug 29 21:40:00.992267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 384/795] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:00 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:02.001933 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:02.002548 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:02.005006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:02.005668 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:02.011007 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=6 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:02.012508 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.012984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.013422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.014140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.014594 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.015019 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.015883 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:02.018307 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:02.025383 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.025915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.026357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.027055 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.027504 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.027933 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.059325 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7e7c2402-cd15-4e92-a3a2-a0cd050ad09d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049567 Aug 29 21:40:02.065408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 385/796] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:02 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:02.065408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:02.065408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:02.072038 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.072526 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.072956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.073645 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.074146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.074550 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.203876 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:02.212231 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4528e599-5604-4c43-809f-cbcfd057ee83 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.214163 Aug 29 21:40:02.212813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 412/797] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:01 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:02.217724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:02.218237 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:02.224728 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.225021 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.225438 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.226165 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.226615 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.227037 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.246949 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:02.255139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ef67bc4f-3299-4a8d-aa85-6e5a859bf0bc tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1367 microversion: 2.1 time: 0.193721 Aug 29 21:40:02.255884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 386/798] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:02 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:02.259016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0cdd93bb-0064-4123-a8eb-0487357acb08 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/4695b9b4-df12-4879-9dd3-4b7508cf78b0" status: 200 len: 194 microversion: 2.1 time: 0.044914 Aug 29 21:40:02.259609 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 413/799] 10.222.0.90 () {58 vars in 1413 bytes} [Mon Aug 29 21:40:02 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/4695b9b4-df12-4879-9dd3-4b7508cf78b0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:02.570083 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-2dca77cd-a8e1-4b09-a0b5-d0499b3414ea req-c716a3ac-d144-4eb2-8bb3-9c1bcec615f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79710085-1445-4ccc-b0e8-9eceadb5a956", "name": "network-vif-plugged", "status": "completed", "tag": "8a9dc579-27fb-4534-8725-09a41e317d71"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:02.588095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-2dca77cd-a8e1-4b09-a0b5-d0499b3414ea req-c716a3ac-d144-4eb2-8bb3-9c1bcec615f4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:02.588583 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-2dca77cd-a8e1-4b09-a0b5-d0499b3414ea req-c716a3ac-d144-4eb2-8bb3-9c1bcec615f4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:02.589032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-2dca77cd-a8e1-4b09-a0b5-d0499b3414ea req-c716a3ac-d144-4eb2-8bb3-9c1bcec615f4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:02.603126 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-2dca77cd-a8e1-4b09-a0b5-d0499b3414ea req-c716a3ac-d144-4eb2-8bb3-9c1bcec615f4 service nova] Creating event network-vif-plugged:8a9dc579-27fb-4534-8725-09a41e317d71 for instance 79710085-1445-4ccc-b0e8-9eceadb5a956 on hv-cinder-85426 Aug 29 21:40:02.619286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-2dca77cd-a8e1-4b09-a0b5-d0499b3414ea req-c716a3ac-d144-4eb2-8bb3-9c1bcec615f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061527 Aug 29 21:40:02.623414 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 387/800] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:03.234712 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:03.235323 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:03.242051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.242605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.242968 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.243698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.244149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.244572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.281069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:03.281989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:03.289238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.289721 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.290252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.290885 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.291350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.291765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.444547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:03.453158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-51ae3ed4-781f-4aac-98f9-5f8d8f744efd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.222829 Aug 29 21:40:03.453748 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 414/801] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:03 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:03.472101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:03.480442 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a24ef2d5-cc50-41f1-861e-0e6c1d6c8225 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1367 microversion: 2.1 time: 0.207650 Aug 29 21:40:03.481023 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 388/802] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:03 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:03.732669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09bc477c-631c-40a6-8246-20cd85d586db"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:03.735158 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:03.744915 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.745749 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.746546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:03.747770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:03.748563 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:03.749318 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.062172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b5c01669-f003-4d6a-93e4-8c553bba455b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "POST /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333221 Aug 29 21:40:04.070189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 415/803] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:40:03 2022] POST /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:04.481646 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:04.482750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:04.489834 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.490816 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.491067 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.491728 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.492389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.492811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.519516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:04.525639 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:04.543662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.544696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.546266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.547848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.549322 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.550324 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.764173 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:04.773459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ad3da4f2-8818-4608-8f94-451dc96e9f60 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.298735 Aug 29 21:40:04.774075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 389/804] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:04 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:04.807747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:04.822662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-506d6bb4-d377-4788-89fb-4f6ba5350415 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1556 microversion: 2.1 time: 0.317963 Aug 29 21:40:04.823244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 416/805] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:04 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1556 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:04.854577 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:04.855077 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:04.862612 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.863343 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.864122 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.865311 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:04.866544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:04.867087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:04.967144 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a0d954aa-b97b-455b-a702-15a3539c5902 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117108 Aug 29 21:40:04.967743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 390/806] 10.222.0.90 () {58 vars in 1275 bytes} [Mon Aug 29 21:40:04 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:05.796902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:05.797529 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:05.809645 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.810167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.810624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:05.811302 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:05.811756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:05.812185 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.055640 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:06.063666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-25d842e9-322f-46bb-b29a-e0450a95aff9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.271053 Aug 29 21:40:06.064339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 417/807] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:05 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:06.405814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-1c980fba-d8a6-4667-b31a-a58819fbf049 req-d03aaf6f-8b3c-41cb-8642-f3e9a16f59a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79710085-1445-4ccc-b0e8-9eceadb5a956", "tag": "8a9dc579-27fb-4534-8725-09a41e317d71"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:06.416268 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-1c980fba-d8a6-4667-b31a-a58819fbf049 req-d03aaf6f-8b3c-41cb-8642-f3e9a16f59a7 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:06.416740 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-1c980fba-d8a6-4667-b31a-a58819fbf049 req-d03aaf6f-8b3c-41cb-8642-f3e9a16f59a7 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:06.417461 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-1c980fba-d8a6-4667-b31a-a58819fbf049 req-d03aaf6f-8b3c-41cb-8642-f3e9a16f59a7 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:06.431790 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-1c980fba-d8a6-4667-b31a-a58819fbf049 req-d03aaf6f-8b3c-41cb-8642-f3e9a16f59a7 service nova] Creating event network-changed:8a9dc579-27fb-4534-8725-09a41e317d71 for instance 79710085-1445-4ccc-b0e8-9eceadb5a956 on hv-cinder-85426 Aug 29 21:40:06.437583 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-1c980fba-d8a6-4667-b31a-a58819fbf049 req-d03aaf6f-8b3c-41cb-8642-f3e9a16f59a7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036379 Aug 29 21:40:06.438676 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 391/808] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:07.092555 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:07.093577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:07.104881 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.105512 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.106169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:07.106913 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:07.107353 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:07.107949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:07.274864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:07.283345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a460957f-74da-4542-b36b-d94e2da1bfd5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.197947 Aug 29 21:40:07.283911 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 418/809] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:07 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:08.308474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:08.309978 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:08.317241 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:08.319131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:08.319826 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:08.320561 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:08.321023 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:08.321454 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:08.510930 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:08.520172 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-603a780f-f42a-4433-81cf-0899a8b5e4d9 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.217979 Aug 29 21:40:08.521505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 392/810] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:08 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:09.541682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:09.542335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:09.548914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:09.549404 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:09.549863 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:09.550635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:09.551136 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:09.551512 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:09.701478 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:09.710586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-639840fd-a3ba-4e09-a966-848228fd5003 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.172686 Aug 29 21:40:09.713909 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 419/811] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:09 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:10.736371 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:10.737110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:10.738953 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:10.748360 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.748870 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.749325 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.750114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:10.750545 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:10.751012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:10.768801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:10.905022 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:10.914161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-963734cf-ee3e-46ed-a68c-c829f18aa381 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.183559 Aug 29 21:40:10.914757 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 393/812] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:10 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:11.694533 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:11.696838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:11.703977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.704458 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.705152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.705930 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.706537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.707201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.740672 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e2462e64-c4a0-4ead-b916-fb2ab5a2a8d0 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050003 Aug 29 21:40:11.741455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 420/813] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:11 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:40:11.881823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:11.882396 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:11.888863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.889361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.889908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.890529 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.890986 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.891411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.923677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4126c100-4ab7-4dfb-8a89-863a7593f935 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/4695b9b4-df12-4879-9dd3-4b7508cf78b0" status: 200 len: 194 microversion: 2.1 time: 0.045871 Aug 29 21:40:11.924296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 394/814] 10.222.0.90 () {58 vars in 1413 bytes} [Mon Aug 29 21:40:11 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/4695b9b4-df12-4879-9dd3-4b7508cf78b0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:11.935111 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:11.935606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:11.941872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.942369 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.943460 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.944488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.944659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.945088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.949146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:11.949770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:11.955976 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.956474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.956912 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:11.957642 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:11.958129 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:11.959355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:12.040551 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lazy-loading 'services' on Instance uuid 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:12.104633 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:12.112836 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b4a23d19-e0bf-45f7-ae4b-eca38d1673dc tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.170079 Aug 29 21:40:12.113328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 395/815] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:11 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:12.128066 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1d158f19-be37-400b-9779-94406e8eaa85 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/4695b9b4-df12-4879-9dd3-4b7508cf78b0" status: 202 len: 0 microversion: 2.1 time: 0.196727 Aug 29 21:40:12.128669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 421/816] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:40:11 2022] DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/4695b9b4-df12-4879-9dd3-4b7508cf78b0 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:40:13.136177 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:13.136963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:13.144048 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:13.144678 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:13.145085 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:13.145850 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:13.146317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:13.146739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:13.311923 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:13.321024 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0d7b5100-ce21-4123-885b-9b61157f8d9d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.188764 Aug 29 21:40:13.321610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 396/817] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:13 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:14.332999 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:14.334854 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:14.338200 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:14.344720 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:14.345740 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:14.347327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.347961 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.349474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.352460 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.353405 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.354144 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.357026 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.357739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.358723 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.359078 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.360609 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.361313 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.384648 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:14.399482 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cef026aa-2b6f-48d3-8dd8-2d168edde907 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/09bc477c-631c-40a6-8246-20cd85d586db" status: 200 len: 194 microversion: 2.1 time: 0.071210 Aug 29 21:40:14.400526 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 422/818] 10.222.0.90 () {58 vars in 1413 bytes} [Mon Aug 29 21:40:14 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/09bc477c-631c-40a6-8246-20cd85d586db => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:14.413770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:14.415005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:14.426673 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.428389 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.429204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.430325 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.431056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.431820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.593841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:14.611903 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lazy-loading 'services' on Instance uuid 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:14.612200 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a2cf0053-158f-42a1-ba7a-da247c44e081 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1569 microversion: 2.1 time: 0.272707 Aug 29 21:40:14.613155 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 397/819] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:14 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:14.644633 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:14.647853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:14.657068 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.657757 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.658364 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.659627 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.660103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.660532 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.721321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-530fed02-1510-4b72-815c-c900a197f25f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/09bc477c-631c-40a6-8246-20cd85d586db" status: 202 len: 0 microversion: 2.1 time: 0.312518 Aug 29 21:40:14.722137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 423/820] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:40:14 2022] DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments/09bc477c-631c-40a6-8246-20cd85d586db => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:40:14.730298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127068) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:40:14.818997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-43488997-c9da-47bf-91bb-b643116981e1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "POST /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1/action" status: 202 len: 0 microversion: 2.1 time: 0.187209 Aug 29 21:40:14.819815 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 398/821] 10.222.0.90 () {60 vars in 1278 bytes} [Mon Aug 29 21:40:14 2022] POST /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:40:14.831532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:14.832260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:14.841387 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.842093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.842599 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:14.843398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:14.844201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:14.844553 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:15.069406 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:15.078425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fe84be0d-8675-4883-bfc6-1f6372b30cc1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1577 microversion: 2.1 time: 0.253837 Aug 29 21:40:15.079017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 424/822] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:14 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:15.220192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:15.221026 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:15.228528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:15.228880 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:15.229420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:15.230119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:15.230602 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:15.231267 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:15.259799 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-fb3a62f0-4c40-4efa-bdb2-6a76f34f507a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/ips" status: 200 len: 153 microversion: 2.20 time: 0.043667 Aug 29 21:40:15.260771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 399/823] 10.222.0.90 () {60 vars in 1289 bytes} [Mon Aug 29 21:40:15 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:40:15.964508 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:15.966897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:15.974482 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:15.975016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:15.975502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:15.976428 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:15.976982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:15.977813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.014344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-94357f3f-3ab1-4d86-948e-8c9d83fc5f94 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055001 Aug 29 21:40:16.015379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 425/824] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:15 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:40:16.119159 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:16.119994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:16.141769 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.142474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.142991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.143630 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.144087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.144690 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.259277 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:16.263403 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:16.276886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.277385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.277850 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.278563 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.279319 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.279418 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.310895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b94ace15-7ea5-45d8-bde3-37b7afcd535b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058878 Aug 29 21:40:16.311673 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 426/825] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:40:16 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:40:16.337527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:16.345582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4be82ac4-14b4-4f2c-a049-b95d1676d9f4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1519 microversion: 2.1 time: 0.231637 Aug 29 21:40:16.346193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 400/826] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:16 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:16.378914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:16.379408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:16.386457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.386945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.387385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.388090 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.388545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.388977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.417305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:40:16.521234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-24fe406f-edd5-4159-ab21-2e90d043a47c tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 204 len: 0 microversion: 2.1 time: 0.145759 Aug 29 21:40:16.521944 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 427/827] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:16 2022] DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:16.530239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:16.530850 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:16.537346 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.537857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.538300 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.538987 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:16.539442 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:16.539875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:16.676327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:16.685558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9a2ad753-da2b-4671-bc02-d48be42d066b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1673 microversion: 2.1 time: 0.159093 Aug 29 21:40:16.686165 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 401/828] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:16 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:17.266562 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:17.267181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:17.274780 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.275260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.275685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.276450 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.276822 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.277239 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.304082 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lazy-loading 'flavor' on Instance uuid 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:40:17.368058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:17.368837 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:17.376298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.376765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.377200 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.377920 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.378558 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.378985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.521284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e9c5a819-be76-4d7d-b8f3-43b18b603204 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/action" status: 202 len: 0 microversion: 2.20 time: 0.257721 Aug 29 21:40:17.522190 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 428/829] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 21:40:17 2022] POST /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:17.533121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:17.534030 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:17.543101 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.543718 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.544257 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.545039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.545579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.546147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.553601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.566508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0f109aa9-7f5e-4053-b8e0-6804813cf5aa tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1519 microversion: 2.1 time: 0.202275 Aug 29 21:40:17.567974 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 402/830] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:17 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:17.704894 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.712316 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:17.713340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:17.718973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.721603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.722793 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.723597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.723772 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7dd93509-0cd2-4657-ad11-b92687db4972 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.195318 Aug 29 21:40:17.724326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.724574 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 429/831] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:17 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:17.726401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:17.727230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:17.727989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:17.883596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:17.896727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b6d1bb91-0f17-42e0-be82-7340fd1db36f tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1673 microversion: 2.1 time: 0.190645 Aug 29 21:40:17.897627 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 403/832] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:17 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:18.175687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-f433fb99-fc5d-41f2-ac11-11396f4c9f2d req-f8d2dcf7-963f-4803-b06a-742aa8860c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3819524d-f3cb-4a48-b655-369801192ff1", "name": "network-vif-unplugged", "status": "completed", "tag": "f25a764e-ad4b-498c-a467-cdffc6e6822b"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:18.187208 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-f433fb99-fc5d-41f2-ac11-11396f4c9f2d req-f8d2dcf7-963f-4803-b06a-742aa8860c5f service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.188255 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-f433fb99-fc5d-41f2-ac11-11396f4c9f2d req-f8d2dcf7-963f-4803-b06a-742aa8860c5f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.188890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-f433fb99-fc5d-41f2-ac11-11396f4c9f2d req-f8d2dcf7-963f-4803-b06a-742aa8860c5f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.202837 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.compute.server_external_events [req-f433fb99-fc5d-41f2-ac11-11396f4c9f2d req-f8d2dcf7-963f-4803-b06a-742aa8860c5f service nova] Unable to find a host for instance 3819524d-f3cb-4a48-b655-369801192ff1. Dropping event network-vif-unplugged {{(pid=127069) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 21:40:18.203707 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-f433fb99-fc5d-41f2-ac11-11396f4c9f2d req-f8d2dcf7-963f-4803-b06a-742aa8860c5f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031904 Aug 29 21:40:18.204294 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 430/833] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 21:40:18.602878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:18.603427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:18.609841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.610320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.610764 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.611443 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.611888 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.612310 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.751696 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:18.760058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-03f94873-7d9d-4b95-ad07-eefe959fd2ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1519 microversion: 2.1 time: 0.161787 Aug 29 21:40:18.760637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 404/834] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:18 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:18.762803 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:18.763756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:18.769404 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.769917 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.770887 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.771600 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.772051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.772473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.920160 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:18.921282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:18.921956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:18.930179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.930975 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.931663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.931768 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:18.932804 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:18.933568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:18.934294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:18.934412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:18.936270 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-93b2e097-4cbd-4c0d-bbf7-55b9d8ed44c2 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.177781 Aug 29 21:40:18.937222 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 431/835] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:18 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:19.082159 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:19.097319 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8014dd06-f17d-4a6c-a0d5-7569bc84c22d tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1673 microversion: 2.1 time: 0.181963 Aug 29 21:40:19.098613 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 405/836] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:18 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:19.785354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:19.787124 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:19.797572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:19.798348 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:19.799075 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:19.800189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:19.800915 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:19.802258 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:19.957500 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:19.964481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:19.965245 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:19.967795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e794ed77-37fa-4210-96c9-6be3fce5d13d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1519 microversion: 2.1 time: 0.188823 Aug 29 21:40:19.968895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 432/837] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:19 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:19.976317 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:19.977161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:19.978121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:19.979344 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:19.980143 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:19.980874 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.126372 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:20.126902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:20.133984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.134611 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.135057 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.135783 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:20.136390 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:20.136654 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:20.143051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:20.152192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:20.153628 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:20.154834 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0d67a5af-3755-484c-a8b2-f659367d236b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.197957 Aug 29 21:40:20.155398 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 406/838] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:19 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:20.292456 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:20.301931 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4cecb545-9ff1-4805-b9a2-fe758abf6043 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1673 microversion: 2.1 time: 0.180574 Aug 29 21:40:20.302516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 433/839] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:20 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:21.003742 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:21.005445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:21.015330 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.016020 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.016818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.017587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.018300 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.018813 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.177364 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:21.194382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a8113c70-5923-4231-bfaa-e9334117bab5 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1519 microversion: 2.1 time: 0.196746 Aug 29 21:40:21.195279 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 407/840] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:20 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:21.315846 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:21.316681 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:21.323184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.323754 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.324134 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.324898 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:21.325125 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.325457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.325623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:21.325920 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.336893 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.337769 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.338687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.339920 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:21.340872 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:21.341626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:21.557024 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:21.565648 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:21.567651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:21.568907 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8cf8ed90-982c-4186-9900-fbb0de997e4f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.393111 Aug 29 21:40:21.569510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 434/841] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:21 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:21.571564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:21.587569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-acb468a7-c2ac-4b10-b52a-b46ebf5416ab tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1673 microversion: 2.1 time: 0.267499 Aug 29 21:40:21.588851 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 408/842] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:21 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:22.216825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:22.217387 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:22.225852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.226274 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.226715 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.227420 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.227865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.228274 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.231283 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:22.441254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:22.455722 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cca62dc6-635d-47fb-bd0a-241c3c95ba4d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1519 microversion: 2.1 time: 0.243103 Aug 29 21:40:22.469922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 435/843] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:22 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:22.616993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:22.619544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:22.619669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:22.620317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:22.634153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.635305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.636263 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.636816 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.637986 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.638375 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.639287 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.639550 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:22.640322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.640698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:22.641053 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.654508 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:22.681836 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:23.016188 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:23.030527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:23.032342 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:23.033743 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-76444f94-c1d1-49ff-b9a7-7dd34389b919 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.428691 Aug 29 21:40:23.035366 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 409/844] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:22 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:23.106816 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:23.115864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a96ee223-f277-4b71-9409-acbdb0c07dd6 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1673 microversion: 2.1 time: 0.504003 Aug 29 21:40:23.116464 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 436/845] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:22 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1673 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:23.484825 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:23.485568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:23.492556 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:23.493042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:23.493471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:23.494299 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:23.494745 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:23.495166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.076547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:24.078532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:24.094401 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.095235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.096000 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.097254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.098773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.099581 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.135358 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:24.159812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4fb1d354-80e8-4bb4-9b96-0c51723c1554 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.679151 Aug 29 21:40:24.179683 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 410/846] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:23 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:24.187686 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:24.188495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:24.199154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.209904 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.210778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.212912 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.214388 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.215460 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.399623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b33a740f1c8a4d9db8d199eff66b76b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2847581073e482d8ec3090bcafe93a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:24.423279 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3ca214b3-e01d-4954-9546-2db0036806c9 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 200 len: 1605 microversion: 2.1 time: 0.240574 Aug 29 21:40:24.424726 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 411/847] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:24 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 1605 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:24.452799 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-847ea2c5-6f34-49a6-8761-3562078b8f5b req-4df963d1-70fc-4928-88b4-1efdff87a63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743da6c0-2fa7-4d79-aefb-9ee0ab0ae395", "name": "network-vif-deleted", "tag": "77f3c7d4-0437-4863-811c-a218a23efaa8"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:24.488083 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-847ea2c5-6f34-49a6-8761-3562078b8f5b req-4df963d1-70fc-4928-88b4-1efdff87a63e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:24.488496 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-847ea2c5-6f34-49a6-8761-3562078b8f5b req-4df963d1-70fc-4928-88b4-1efdff87a63e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:24.489585 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-847ea2c5-6f34-49a6-8761-3562078b8f5b req-4df963d1-70fc-4928-88b4-1efdff87a63e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:24.523619 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-847ea2c5-6f34-49a6-8761-3562078b8f5b req-4df963d1-70fc-4928-88b4-1efdff87a63e service nova] Creating event network-vif-deleted:77f3c7d4-0437-4863-811c-a218a23efaa8 for instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 on hv-cinder-85426 Aug 29 21:40:24.531045 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-847ea2c5-6f34-49a6-8761-3562078b8f5b req-4df963d1-70fc-4928-88b4-1efdff87a63e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101035 Aug 29 21:40:24.531990 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 412/848] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:24.577253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:24.589508 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:24.591660 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:24.592814 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-729dcf0d-36a1-43b0-9654-d710c7d73d70 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.524398 Aug 29 21:40:24.593377 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 437/849] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:24 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:25.193259 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:25.194740 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:25.206042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.207094 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.207845 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.209248 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.209730 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.210988 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.403297 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:25.412738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2b4ea4bf-7ffe-474b-adf9-8b838efc6303 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.227781 Aug 29 21:40:25.413322 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 413/850] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:25 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:25.455854 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:25.456783 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:25.467593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.468198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.468638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.469706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.474027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.474027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.490373 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] HTTP exception thrown: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Request method failure captured: Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 HTTP/1.1 Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDApWhyAmKUjbE5wkc6k80Py8uXR_b4HVPTbr-aro-_er8Qnv-DAjW6n0GYYwGgjmfDF7-jgCKZWPvt113398OXOYoc_e51mEX8L5VuIL-dRvmvUG6twZAE_hZysBmfrdnaLawLKmKJ9qrPC-Yk2RPrLKgEcfuJDqac1uPQFYlWNl8 Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:40:25.492610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2847581073e482d8ec3090bcafe93a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: b33a740f1c8a4d9db8d199eff66b76b2 Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:25.495653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '743da6c0-2fa7-4d79-aefb-9ee0ab0ae395'} Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:25.498352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:25.502618 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:25.505927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Returning 404 to user: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:25.505927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a6b66b6a-bd81-4f52-b989-469eaad832c5 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 404 len: 111 microversion: 2.1 time: 0.045513 Aug 29 21:40:25.505927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 438/851] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:25 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:25.509827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-13604ef2-c550-45ce-b02d-db0d91130cfd tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '.version_select at 0x7f8bdf6bbdc0>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:25.549395 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-13604ef2-c550-45ce-b02d-db0d91130cfd tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-279858710" status: 202 len: 0 microversion: 2.1 time: 0.045799 Aug 29 21:40:25.550634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 414/852] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 21:40:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-279858710 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:40:25.621358 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:25.621891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:25.631552 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.632084 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.632798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.633679 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:25.634566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:25.635209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:25.923613 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:25.944308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:25.947485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:25.954830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0dd9f31e-42ca-48b5-9b76-27e90a5cfddc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.333739 Aug 29 21:40:25.955639 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 439/853] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:25 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:26.439773 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:26.440927 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:26.456901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:26.458873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:26.459587 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:26.460750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:26.461410 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:26.462187 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:26.661859 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:26.670000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a7ae90b4-8012-487a-8c1a-abaf02f28dfd tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.238554 Aug 29 21:40:26.670578 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 415/854] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:26 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:26.979803 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:26.980517 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:26.987502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:26.988065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:26.989362 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:26.990363 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:26.990935 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:26.991465 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:27.143889 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:27.155324 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:27.156770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:27.157987 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-45b45943-de1b-4a8a-842e-68b9b4379359 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.182620 Aug 29 21:40:27.158546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 440/855] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:26 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:27.707528 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:27.710675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:27.734219 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:27.737906 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:27.741415 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:27.742835 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:27.744061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:27.745084 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:27.938701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:27.947134 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4b6b7491-f3f3-4d25-b641-7776096e288a tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.246786 Aug 29 21:40:27.947763 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 416/856] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:27 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:28.194243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:28.194841 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:28.203153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:28.203651 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:28.204358 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:28.205134 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:28.205624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:28.206092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:28.352877 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:28.361696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:28.363191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:28.364606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7ac21773-2ee2-4be8-a29a-8c597d525ffc tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.175673 Aug 29 21:40:28.365168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 441/857] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:28 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:28.950693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:28.951508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:28.963405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:28.965648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:28.965648 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:28.974321 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:28.974637 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:28.975350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:28.976112 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:28.976112 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:28.990139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:28.990139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:28.990139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:28.990139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:28.990537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:28.990537 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:29.004906 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] HTTP exception thrown: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Request method failure captured: Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 HTTP/1.1 Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDApWhyAmKUjbE5wkc6k80Py8uXR_b4HVPTbr-aro-_er8Qnv-DAjW6n0GYYwGgjmfDF7-jgCKZWPvt113398OXOYoc_e51mEX8L5VuIL-dRvmvUG6twZAE_hZysBmfrdnaLawLKmKJ9qrPC-Yk2RPrLKgEcfuJDqac1uPQFYlWNl8 Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:40:29.008001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2847581073e482d8ec3090bcafe93a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: b33a740f1c8a4d9db8d199eff66b76b2 Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.009626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '743da6c0-2fa7-4d79-aefb-9ee0ab0ae395'} Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:29.010595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.012042 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.013399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Returning 404 to user: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:29.013399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-62099ddb-37ff-4ddf-a50a-e91d940d0f73 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 404 len: 111 microversion: 2.1 time: 0.066848 Aug 29 21:40:29.016467 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 417/858] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:28 2022] DELETE /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:29.022035 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:29.022657 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:29.028844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:29.029330 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:29.029762 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:29.030492 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:29.030941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:29.031361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:29.047797 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] HTTP exception thrown: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Request method failure captured: Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 HTTP/1.1 Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDApWhyAmKUjbE5wkc6k80Py8uXR_b4HVPTbr-aro-_er8Qnv-DAjW6n0GYYwGgjmfDF7-jgCKZWPvt113398OXOYoc_e51mEX8L5VuIL-dRvmvUG6twZAE_hZysBmfrdnaLawLKmKJ9qrPC-Yk2RPrLKgEcfuJDqac1uPQFYlWNl8 Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:40:29.049355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2847581073e482d8ec3090bcafe93a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: b33a740f1c8a4d9db8d199eff66b76b2 Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.052632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '743da6c0-2fa7-4d79-aefb-9ee0ab0ae395'} Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:29.053913 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. Aug 29 21:40:29.056236 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:29.058256 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Returning 404 to user: Instance 743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:29.058256 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b8f6119d-93c7-4d8b-b240-a72f325f98d3 tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395" status: 404 len: 111 microversion: 2.1 time: 0.033330 Aug 29 21:40:29.058256 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 418/859] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:29 2022] GET /compute/v2.1/servers/743da6c0-2fa7-4d79-aefb-9ee0ab0ae395 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:29.219808 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:29.233933 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-77f7bcd7-a563-46f4-b644-c002facb22e0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.266274 Aug 29 21:40:29.235339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 442/860] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:28 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:29.399154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:29.399985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:29.407764 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:29.408421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:29.409123 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:29.410121 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:29.410982 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:29.411175 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:29.579788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:29.589500 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:29.591025 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:29.592198 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f52c7c70-0b92-4a17-88e5-0f00a53d0650 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.201189 Aug 29 21:40:29.592771 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 419/861] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:29 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:30.265822 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:30.266570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:30.271706 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:30.272564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:30.274596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.274986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.275428 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.276199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.276656 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.277087 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.280607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.281167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.281721 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.282787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.283326 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.283843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.293040 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] HTTP exception thrown: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Request method failure captured: Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d HTTP/1.1 Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDApWhyAmKUjbE5wkc6k80Py8uXR_b4HVPTbr-aro-_er8Qnv-DAjW6n0GYYwGgjmfDF7-jgCKZWPvt113398OXOYoc_e51mEX8L5VuIL-dRvmvUG6twZAE_hZysBmfrdnaLawLKmKJ9qrPC-Yk2RPrLKgEcfuJDqac1uPQFYlWNl8 Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:40:30.294704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2847581073e482d8ec3090bcafe93a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: b33a740f1c8a4d9db8d199eff66b76b2 Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.297421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d'} Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:30.298782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.303435 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.308469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Returning 404 to user: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:30.308469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-067aefdb-0f6a-4d9c-94bd-a7168ab6fc1b tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 404 len: 111 microversion: 2.1 time: 0.034254 Aug 29 21:40:30.308469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 443/862] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:40:30 2022] DELETE /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:30.308469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:30.308796 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] [instance: 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:30.316199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.316773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.317287 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.318060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.318522 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.318943 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.342049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] HTTP exception thrown: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Request method failure captured: Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d HTTP/1.1 Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDApWhyAmKUjbE5wkc6k80Py8uXR_b4HVPTbr-aro-_er8Qnv-DAjW6n0GYYwGgjmfDF7-jgCKZWPvt113398OXOYoc_e51mEX8L5VuIL-dRvmvUG6twZAE_hZysBmfrdnaLawLKmKJ9qrPC-Yk2RPrLKgEcfuJDqac1uPQFYlWNl8 Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:40:30.343629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a2847581073e482d8ec3090bcafe93a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a2847581073e482d8ec3090bcafe93a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: a2847581073e482d8ec3090bcafe93a7 Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2059626786 Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: b33a740f1c8a4d9db8d199eff66b76b2 Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeTestJSON-2059626786-project Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.345355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d'} Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:30.346184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. Aug 29 21:40:30.348213 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:30.349619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] Returning 404 to user: Instance 9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:30.349619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9f1c3024-1d53-4a52-a52e-f1471ccc28ae tempest-AttachVolumeTestJSON-2059626786 tempest-AttachVolumeTestJSON-2059626786-project] 10.222.0.90 "GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d" status: 404 len: 111 microversion: 2.1 time: 0.043892 Aug 29 21:40:30.349619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 444/863] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:30 2022] GET /compute/v2.1/servers/9cc438e7-bf3a-4d04-98c7-8bd90ee8d36d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:30.476757 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:30.490456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-12649cc5-bb51-4733-bc47-40c5c6547cf2 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.222060 Aug 29 21:40:30.491228 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 420/864] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:30 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:30.616573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:30.617205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:30.623485 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.623977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.624410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.625123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:30.625572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:30.626025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:30.940137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:30.950765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:30.952214 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:30.953437 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e2250fc0-975b-4f5c-9f56-1048fbbd9420 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.341493 Aug 29 21:40:30.954272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 445/865] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:30 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:31.526172 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:31.527508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:31.538853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:31.540181 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:31.541010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:31.542293 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:31.543145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:31.543947 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:31.726970 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:31.743436 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-eab1e2e2-13ce-420c-a11f-6cadbdd93d32 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.224340 Aug 29 21:40:31.744480 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 421/866] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:31 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:31.978680 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:31.979418 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:31.986425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:31.986919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:31.987352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:31.988053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:31.989243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:31.989243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:32.149468 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:32.158813 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:32.160971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:32.162098 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-ee527b82-b802-499f-b766-39a650993c16 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.187464 Aug 29 21:40:32.162654 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 446/867] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:31 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:32.775673 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:32.776922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:32.792711 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:32.793713 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:32.794623 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:32.796032 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:32.796972 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:32.797952 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:33.083262 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:33.092403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0017e2b2-f5b1-417f-a43d-9bc2f17fc273 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.325375 Aug 29 21:40:33.093324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 422/868] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:32 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:33.187014 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:33.187705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:33.197491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:33.198033 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:33.198750 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:33.200153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:33.200827 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:33.201709 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:33.421607 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:33.436908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:33.438704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:33.440277 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-719b7279-5d33-4d24-adac-c75cce8f0cca tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.256929 Aug 29 21:40:33.445856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 447/869] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:33 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:34.122640 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:34.123776 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:34.132634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:34.133165 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:34.133846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:34.134977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:34.135497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:34.136114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:34.419622 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:34.442758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8473f939-62f1-4179-8050-fc5a4674e5bb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.314292 Aug 29 21:40:34.445672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 423/870] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:34 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:34.479609 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:34.480332 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:34.487183 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:34.487748 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:34.488701 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:34.491427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:34.492258 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:34.492848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:34.815373 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:34.845305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:34.848270 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:34.850620 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e46013dc-8ecd-4de2-b304-104adb1c5274 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.374664 Aug 29 21:40:34.866371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 448/871] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:34 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:35.469072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:35.469698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:35.478563 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:35.480061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:35.480061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:35.480396 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:35.481045 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:35.481557 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:35.664428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:35.673179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-772c9fa7-af4c-4121-8112-7536cfff9cab tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.209782 Aug 29 21:40:35.687871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 424/872] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:35 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:35.884949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:35.885577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:35.892553 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:35.893031 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:35.893644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:35.895055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:35.895633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:35.896059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:36.129371 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:36.142800 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:36.144162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:36.146073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6ad63178-7106-48ae-800b-2c72d15f7ce1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.265132 Aug 29 21:40:36.146845 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 449/873] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:35 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:36.549522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49070df4-fe77-4778-b24a-2a46716bd98d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Action: 'create', calling method: .version_select at 0x7f8bdf5d71f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2142827580", "metadata": {"Type": "work"}}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49070df4-fe77-4778-b24a-2a46716bd98d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Request method failure captured: Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 122 Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTJUa_DtWbyBxydNMpbLD3nQcTyFvtiv69QduHCNFaU3tihJ_d3yiI57tCO4-SchFcnb4KqzP6rVhVP0x5fRrGipeQPMGRxBh1mnKd3qOSuAMwuR15sar_3Xbl_pU4UmiZr0H_ERBiUvlU9yzrYi1n9LasAMvUW4ThQxpJk_fiOFgyg Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:40:36.562747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1c8fe22edbdd4ab5b4006dc5c526ec5f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 3be7a2a7ca204a5aa38907b9d08cdf7b Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2142827580", "metadata": {"Type": "work"}}} Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: Aug 29 21:40:36.564379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2142827580', 'metadata': {'Type': 'work'}}}} Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:36.565416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:40:36.569373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:40:36.570812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 21:40:36.570812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.570812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49070df4-fe77-4778-b24a-2a46716bd98d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:36.570812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-49070df4-fe77-4778-b24a-2a46716bd98d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.291510 Aug 29 21:40:36.570812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 425/874] 10.222.0.90 () {60 vars in 1156 bytes} [Mon Aug 29 21:40:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:40:36.574929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0f0726f3-1f1b-4a99-9c4c-12c9aa43c4d3 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Action: 'create', calling method: .version_select at 0x7f8bdf878a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-882287763", "metadata": {"Type": "work"}}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0f0726f3-1f1b-4a99-9c4c-12c9aa43c4d3 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Request method failure captured: Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 119 Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTJUa_DtWbyBxydNMpbLD3nQcTyFvtiv69QduHCNFaU3tihJ_d3yiI57tCO4-SchFcnb4KqzP6rVhVP0x5fRrGipeQPMGRxBh1mnKd3qOSuAMwuR15sar_3Xbl_pU4UmiZr0H_ERBiUvlU9yzrYi1n9LasAMvUW4ThQxpJk_fiOFgyg Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:40:36.580271 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1c8fe22edbdd4ab5b4006dc5c526ec5f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 3be7a2a7ca204a5aa38907b9d08cdf7b Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-882287763", "metadata": {"Type": "work"}}} Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: Aug 29 21:40:36.582051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-882287763', 'metadata': {'Type': 'work'}}}} Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi '0' Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:36.583013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:40:36.584463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:40:36.585632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 21:40:36.585632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.585632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0f0726f3-1f1b-4a99-9c4c-12c9aa43c4d3 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:36.585632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0f0726f3-1f1b-4a99-9c4c-12c9aa43c4d3 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011060 Aug 29 21:40:36.585632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 450/875] 10.222.0.90 () {60 vars in 1156 bytes} [Mon Aug 29 21:40:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:40:36.592630 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49196190-37df-4014-b383-11a7c423b2cf tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Action: 'create', calling method: .version_select at 0x7f8bdf63ee50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2002939272", "metadata": {"Type": "work"}}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49196190-37df-4014-b383-11a7c423b2cf tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Request method failure captured: Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 119 Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTJUa_DtWbyBxydNMpbLD3nQcTyFvtiv69QduHCNFaU3tihJ_d3yiI57tCO4-SchFcnb4KqzP6rVhVP0x5fRrGipeQPMGRxBh1mnKd3qOSuAMwuR15sar_3Xbl_pU4UmiZr0H_ERBiUvlU9yzrYi1n9LasAMvUW4ThQxpJk_fiOFgyg Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:40:36.597922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1c8fe22edbdd4ab5b4006dc5c526ec5f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 3be7a2a7ca204a5aa38907b9d08cdf7b Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2002939272", "metadata": {"Type": "work"}}} Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: Aug 29 21:40:36.599373 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2002939272', 'metadata': {'Type': 'work'}}}} Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise error Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi '' Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:36.600214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 21:40:36.602127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 21:40:36.603523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 21:40:36.603523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.603523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49196190-37df-4014-b383-11a7c423b2cf tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:36.603523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-49196190-37df-4014-b383-11a7c423b2cf tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011709 Aug 29 21:40:36.603523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 426/876] 10.222.0.90 () {60 vars in 1156 bytes} [Mon Aug 29 21:40:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:40:36.611839 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b75aec2d-eef7-4546-b359-34dc71b69f5a tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Calling method '.version_select at 0x7f8bdf75cd30>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:36.643521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-b75aec2d-eef7-4546-b359-34dc71b69f5a tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] HTTP exception thrown: Volume tempest-invalid-1631177936 could not be found. Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b75aec2d-eef7-4546-b359-34dc71b69f5a tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Request method failure captured: Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1631177936 HTTP/1.1 Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTJUa_DtWbyBxydNMpbLD3nQcTyFvtiv69QduHCNFaU3tihJ_d3yiI57tCO4-SchFcnb4KqzP6rVhVP0x5fRrGipeQPMGRxBh1mnKd3qOSuAMwuR15sar_3Xbl_pU4UmiZr0H_ERBiUvlU9yzrYi1n9LasAMvUW4ThQxpJk_fiOFgyg Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:40:36.646345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1c8fe22edbdd4ab5b4006dc5c526ec5f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 3be7a2a7ca204a5aa38907b9d08cdf7b Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Volume tempest-invalid-1631177936 could not be found. Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': 'tempest-invalid-1631177936'} Aug 29 21:40:36.648146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1631177936 could not be found. (HTTP 404) (Request-ID: req-1d7a25f7-d31b-44b0-895e-6c272ed290f4) Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.649314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:40:36.650657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1631177936 could not be found. Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:36.652491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1631177936 could not be found. Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1631177936 could not be found. Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b75aec2d-eef7-4546-b359-34dc71b69f5a tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Returning 404 to user: Volume tempest-invalid-1631177936 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b75aec2d-eef7-4546-b359-34dc71b69f5a tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1631177936" status: 404 len: 99 microversion: 2.1 time: 0.039928 Aug 29 21:40:36.654253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 451/877] 10.222.0.90 () {58 vars in 1218 bytes} [Mon Aug 29 21:40:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1631177936 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 21:40:36.663056 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cf759d61-ae23-46af-8ca2-7928d59c5e1a tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004708 Aug 29 21:40:36.663586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 427/878] 10.222.0.90 () {58 vars in 1140 bytes} [Mon Aug 29 21:40:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 21:40:36.675497 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d91b5781-70ff-4175-bcc3-6ae359768b6d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004573 Aug 29 21:40:36.676894 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 452/879] 10.222.0.90 () {58 vars in 1137 bytes} [Mon Aug 29 21:40:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 21:40:36.686908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6a07cc87-394c-4177-9639-fcda77f56b58 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Calling method '.version_select at 0x7f8bdf667700>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:36.695583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:36.696604 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:36.703280 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:36.703818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:36.704514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:36.705253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:36.705881 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:36.706317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:36.720274 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-6a07cc87-394c-4177-9639-fcda77f56b58 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] HTTP exception thrown: Volume 2c1b366d-9713-478b-85cd-ac6735752222 could not be found. Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6a07cc87-394c-4177-9639-fcda77f56b58 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Request method failure captured: Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: DELETE /compute/v2.1/os-volumes/2c1b366d-9713-478b-85cd-ac6735752222 HTTP/1.1 Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTJUa_DtWbyBxydNMpbLD3nQcTyFvtiv69QduHCNFaU3tihJ_d3yiI57tCO4-SchFcnb4KqzP6rVhVP0x5fRrGipeQPMGRxBh1mnKd3qOSuAMwuR15sar_3Xbl_pU4UmiZr0H_ERBiUvlU9yzrYi1n9LasAMvUW4ThQxpJk_fiOFgyg Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:40:36.723707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1c8fe22edbdd4ab5b4006dc5c526ec5f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 3be7a2a7ca204a5aa38907b9d08cdf7b Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Volume 2c1b366d-9713-478b-85cd-ac6735752222 could not be found. Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '2c1b366d-9713-478b-85cd-ac6735752222'} Aug 29 21:40:36.727064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c1b366d-9713-478b-85cd-ac6735752222 could not be found. (HTTP 404) (Request-ID: req-fdca9660-9572-403c-8a7c-a3e5111e5804) Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.734049 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:40:36.735391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c1b366d-9713-478b-85cd-ac6735752222 could not be found. Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:40:36.736541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c1b366d-9713-478b-85cd-ac6735752222 could not be found. Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c1b366d-9713-478b-85cd-ac6735752222 could not be found. Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6a07cc87-394c-4177-9639-fcda77f56b58 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Returning 404 to user: Volume 2c1b366d-9713-478b-85cd-ac6735752222 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6a07cc87-394c-4177-9639-fcda77f56b58 tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/2c1b366d-9713-478b-85cd-ac6735752222" status: 404 len: 109 microversion: 2.1 time: 0.042774 Aug 29 21:40:36.737746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 428/880] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:40:36 2022] DELETE /compute/v2.1/os-volumes/2c1b366d-9713-478b-85cd-ac6735752222 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:40:36.743308 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-de88c6ec-608c-4af7-98de-51f496c20a1d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Calling method '.version_select at 0x7f8bdf5d7040>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:36.780461 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-de88c6ec-608c-4af7-98de-51f496c20a1d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] HTTP exception thrown: Volume eb1498cb-9ce4-4fd0-be1e-e388522f449b could not be found. Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-de88c6ec-608c-4af7-98de-51f496c20a1d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Request method failure captured: Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/os-volumes/eb1498cb-9ce4-4fd0-be1e-e388522f449b HTTP/1.1 Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTJUa_DtWbyBxydNMpbLD3nQcTyFvtiv69QduHCNFaU3tihJ_d3yiI57tCO4-SchFcnb4KqzP6rVhVP0x5fRrGipeQPMGRxBh1mnKd3qOSuAMwuR15sar_3Xbl_pU4UmiZr0H_ERBiUvlU9yzrYi1n9LasAMvUW4ThQxpJk_fiOFgyg Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:40:36.782433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1c8fe22edbdd4ab5b4006dc5c526ec5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1c8fe22edbdd4ab5b4006dc5c526ec5f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1c8fe22edbdd4ab5b4006dc5c526ec5f Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesNegativeTest-607411745 Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 3be7a2a7ca204a5aa38907b9d08cdf7b Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesNegativeTest-607411745-project Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Volume eb1498cb-9ce4-4fd0-be1e-e388522f449b could not be found. Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'eb1498cb-9ce4-4fd0-be1e-e388522f449b'} Aug 29 21:40:36.784152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb1498cb-9ce4-4fd0-be1e-e388522f449b could not be found. (HTTP 404) (Request-ID: req-51bfc397-0292-4ba7-9662-b929f5541488) Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.786231 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:40:36.787663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb1498cb-9ce4-4fd0-be1e-e388522f449b could not be found. Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:40:36.789116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb1498cb-9ce4-4fd0-be1e-e388522f449b could not be found. Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb1498cb-9ce4-4fd0-be1e-e388522f449b could not be found. Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-de88c6ec-608c-4af7-98de-51f496c20a1d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] Returning 404 to user: Volume eb1498cb-9ce4-4fd0-be1e-e388522f449b could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-de88c6ec-608c-4af7-98de-51f496c20a1d tempest-VolumesNegativeTest-607411745 tempest-VolumesNegativeTest-607411745-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/eb1498cb-9ce4-4fd0-be1e-e388522f449b" status: 404 len: 109 microversion: 2.1 time: 0.049509 Aug 29 21:40:36.790510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 429/881] 10.222.0.90 () {58 vars in 1245 bytes} [Mon Aug 29 21:40:36 2022] GET /compute/v2.1/os-volumes/eb1498cb-9ce4-4fd0-be1e-e388522f449b => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:40:36.920308 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:36.931546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e06294a2-a606-4e6c-959d-88654ddc41c1 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.240333 Aug 29 21:40:36.932309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 453/882] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:36 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:40:37.170391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:37.171286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:37.180052 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:37.180624 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:37.181137 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:37.181969 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:37.182499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:37.183150 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:37.254985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-d12438a1-fdeb-43f8-9a43-c65bdb48379d req-bd5be697-7e87-4eb9-94d2-14f74836e143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3819524d-f3cb-4a48-b655-369801192ff1", "name": "network-vif-plugged", "status": "completed", "tag": "f25a764e-ad4b-498c-a467-cdffc6e6822b"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:37.270212 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-d12438a1-fdeb-43f8-9a43-c65bdb48379d req-bd5be697-7e87-4eb9-94d2-14f74836e143 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:37.271207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-d12438a1-fdeb-43f8-9a43-c65bdb48379d req-bd5be697-7e87-4eb9-94d2-14f74836e143 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:37.271825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-d12438a1-fdeb-43f8-9a43-c65bdb48379d req-bd5be697-7e87-4eb9-94d2-14f74836e143 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:37.286580 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-d12438a1-fdeb-43f8-9a43-c65bdb48379d req-bd5be697-7e87-4eb9-94d2-14f74836e143 service nova] Creating event network-vif-plugged:f25a764e-ad4b-498c-a467-cdffc6e6822b for instance 3819524d-f3cb-4a48-b655-369801192ff1 on hv-cinder-85426 Aug 29 21:40:37.295973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-d12438a1-fdeb-43f8-9a43-c65bdb48379d req-bd5be697-7e87-4eb9-94d2-14f74836e143 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043367 Aug 29 21:40:37.298206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 454/883] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:37.424324 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:37.446235 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:37.447704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:37.449115 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-64b89574-f705-46c6-a632-fc8a1bd31f55 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.282567 Aug 29 21:40:37.450282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 430/884] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:37 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:37.964306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:37.964306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:37.967139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:37.967635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:37.968071 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:37.968781 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:37.969301 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:37.970590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.150326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:38.161593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fe5dda36-1af2-47f5-a4da-9b9511397cb0 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1575 microversion: 2.1 time: 0.207426 Aug 29 21:40:38.174470 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 455/885] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:37 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:38.476871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:38.490250 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:38.506327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.506902 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.507546 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.508260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:38.508716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:38.509314 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:38.752147 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:38.762459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:38.764225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:38.765736 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e4f3a655-660b-4b0e-b5a6-5b5bfe1443c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1747 microversion: 2.20 time: 0.295827 Aug 29 21:40:38.766512 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 431/886] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:38 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1747 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:39.183692 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:39.184874 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:39.194857 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.196422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.197079 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.198089 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.198629 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.199309 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.484016 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:39.498138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-553825d5-5513-4f96-8dd1-c96f721bf5ca tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1562 microversion: 2.1 time: 0.317926 Aug 29 21:40:39.509811 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 456/887] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:40:39 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1562 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:40:39.789306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:39.789962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:39.796679 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.797179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.797684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.798445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:39.798919 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:39.799394 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:39.970569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:39.980257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:39.981864 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:39.983043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3f26388b-b070-44ea-a3b2-93d0e76a8925 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1747 microversion: 2.20 time: 0.198537 Aug 29 21:40:39.983600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 432/888] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:39 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1747 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:41.007597 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:41.008359 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:41.015237 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:41.015781 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:41.016550 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:41.017265 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:41.018121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:41.018546 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:41.038870 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=100 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:41.221734 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:41.231993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:41.233772 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:41.235303 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fbf4c916-4938-4a79-bb43-17ef08d43c06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.232479 Aug 29 21:40:41.246297 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 457/889] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:41 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:42.262861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:42.264194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:42.266735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:42.274355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.275671 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.276411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.277242 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:42.277776 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:42.278476 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:42.467342 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:42.479211 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:42.480704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:42.483072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-788753b1-e932-40a2-9069-f58ac089156a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.225589 Aug 29 21:40:42.483987 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 433/890] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:42 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:43.509778 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:43.510412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:43.519274 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.520206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.521064 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.521746 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:43.522230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:43.523595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:43.732078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:43.749905 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:43.751999 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:43.753835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-653b1fc9-432f-4af1-9d0b-8cd26ac1080d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.247612 Aug 29 21:40:43.770492 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 458/891] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:43 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:44.779888 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:44.780811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:44.817292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.817934 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.818618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.819766 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:44.820166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:44.820594 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:44.840758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:45.057416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:45.074997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:45.076971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:45.078456 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0b61536b-1422-48ad-a021-2d7a091d10e5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.304352 Aug 29 21:40:45.080079 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 434/892] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:44 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:46.112230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:46.114664 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:46.117273 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:40:46.124511 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:46.125164 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:46.125969 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:46.127044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:46.127718 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:46.128993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:46.305401 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:46.315265 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:46.317236 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:46.318963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cd5c2986-050a-40b3-b469-23173991cf1b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.212018 Aug 29 21:40:46.319422 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 459/893] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:46 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:47.030869 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-d8f9a3dc-75a1-41e9-bf58-0188067597bb req-8530e6bf-98f2-49ce-bf4b-644a4ccc8664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc41e68-4172-413f-bb4f-08e5b1bc1b70", "name": "network-vif-plugged", "status": "completed", "tag": "84e78a81-6684-42c4-bd59-4c45cc70b49e"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:47.042257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-d8f9a3dc-75a1-41e9-bf58-0188067597bb req-8530e6bf-98f2-49ce-bf4b-644a4ccc8664 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.043199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-d8f9a3dc-75a1-41e9-bf58-0188067597bb req-8530e6bf-98f2-49ce-bf4b-644a4ccc8664 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.044179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-d8f9a3dc-75a1-41e9-bf58-0188067597bb req-8530e6bf-98f2-49ce-bf4b-644a4ccc8664 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:47.061101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-d8f9a3dc-75a1-41e9-bf58-0188067597bb req-8530e6bf-98f2-49ce-bf4b-644a4ccc8664 service nova] Creating event network-vif-plugged:84e78a81-6684-42c4-bd59-4c45cc70b49e for instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 on hv-cinder-85426 Aug 29 21:40:47.069697 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-d8f9a3dc-75a1-41e9-bf58-0188067597bb req-8530e6bf-98f2-49ce-bf4b-644a4ccc8664 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042094 Aug 29 21:40:47.070645 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 435/894] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:47.345074 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:47.345678 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:47.352072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.352554 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.353009 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:47.353697 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:47.354202 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:47.354698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:47.520891 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:47.533162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:47.534918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:47.536181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2cfc304a-613f-46f1-ad51-372094773da9 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.195284 Aug 29 21:40:47.536741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 460/895] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:47 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:48.560932 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:48.562541 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:48.570989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:48.571724 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:48.572357 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:48.573238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:48.573689 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:48.574488 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:48.733863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:48.750198 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:48.752482 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:48.754684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-fa0ee46b-2907-4051-b1bc-3919d0ce18e3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.198717 Aug 29 21:40:48.760960 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 436/896] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:48 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:49.778587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:49.779792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:49.788110 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:49.788674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:49.789307 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:49.790239 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:49.790897 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:49.791487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:49.939067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:49.949206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:49.950919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:49.952312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-610d0545-41c0-4a39-b9d3-05ef7f0bb2c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.178410 Aug 29 21:40:49.968809 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 461/897] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:49 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:50.146517 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:50.147074 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:50.154087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:50.154865 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:50.155496 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:50.156391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:50.156928 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:50.157420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:50.188330 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-030fb7d0-8cdd-469b-8736-ec3c0aad37d2 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/ips" status: 200 len: 149 microversion: 2.1 time: 0.046306 Aug 29 21:40:50.196940 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 437/898] 10.222.0.90 () {58 vars in 1248 bytes} [Mon Aug 29 21:40:50 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:50.976919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:50.977469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:50.984178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:50.984617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:50.985041 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:50.985764 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:50.986244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:50.986659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:51.117990 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:51.126323 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:51.127829 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:51.129477 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-62cfd24c-c000-452d-82b7-956015ad3c5c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1742 microversion: 2.20 time: 0.156971 Aug 29 21:40:51.130069 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 462/899] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:50 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:51.641389 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32523cc7-2608-43f2-a251-86517f72b674"}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:51.645145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:51.652818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:51.653311 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:51.653856 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:51.654491 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:51.654943 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:51.655367 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:51.946881 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0ed47090-7ff0-4177-af79-060fb6eca13d tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "POST /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309291 Aug 29 21:40:51.947499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 438/900] 10.222.0.90 () {60 vars in 1323 bytes} [Mon Aug 29 21:40:51 2022] POST /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:52.153353 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:52.153888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:52.160569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:52.161048 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:52.161484 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:52.162207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:52.162708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:52.163091 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:52.296908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:52.305120 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:52.306596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:52.307738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3d1a56ff-0686-436a-951e-d76c3a3f562e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1724 microversion: 2.20 time: 0.158410 Aug 29 21:40:52.308284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 463/901] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:52 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:53.334294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:53.334989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:53.341472 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.342010 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.342481 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.343202 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:53.343704 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:53.344127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:53.489866 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:53.498033 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:53.499478 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:53.500634 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a73e3300-8d16-4e66-9329-69c24a482816 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1724 microversion: 2.20 time: 0.172396 Aug 29 21:40:53.501193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 439/902] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:53 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:54.523633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:54.524231 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:54.530955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.531437 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.531872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.532575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.533022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.533446 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.678571 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:54.691741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:54.693199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:54.694513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7121e7ef-d56a-42a2-9129-acc9c7d61e15 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1724 microversion: 2.20 time: 0.174852 Aug 29 21:40:54.695326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 464/903] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:54 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:54.807131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-3fa0ac51-bc95-4670-aa3e-8cd3d3a3a5e0 req-07a09c37-9fb1-4212-9f57-c3d26efffaa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc41e68-4172-413f-bb4f-08e5b1bc1b70", "name": "network-vif-unplugged", "status": "completed", "tag": "84e78a81-6684-42c4-bd59-4c45cc70b49e"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:54.825367 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-3fa0ac51-bc95-4670-aa3e-8cd3d3a3a5e0 req-07a09c37-9fb1-4212-9f57-c3d26efffaa4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:54.826385 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-3fa0ac51-bc95-4670-aa3e-8cd3d3a3a5e0 req-07a09c37-9fb1-4212-9f57-c3d26efffaa4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:54.827190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-3fa0ac51-bc95-4670-aa3e-8cd3d3a3a5e0 req-07a09c37-9fb1-4212-9f57-c3d26efffaa4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:54.849500 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-3fa0ac51-bc95-4670-aa3e-8cd3d3a3a5e0 req-07a09c37-9fb1-4212-9f57-c3d26efffaa4 service nova] Creating event network-vif-unplugged:84e78a81-6684-42c4-bd59-4c45cc70b49e for instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 on hv-cinder-85426 Aug 29 21:40:54.854670 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-3fa0ac51-bc95-4670-aa3e-8cd3d3a3a5e0 req-07a09c37-9fb1-4212-9f57-c3d26efffaa4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051581 Aug 29 21:40:54.855464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 440/904] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:40:55.719999 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:55.720534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:55.727823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:55.728306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:55.728742 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:55.729531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:55.730026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:55.730334 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:55.867447 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:55.875782 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:55.877230 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:55.879001 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5b6dc0d6-4ee9-4919-8d6c-0a86476fde77 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1724 microversion: 2.20 time: 0.163059 Aug 29 21:40:55.879553 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 465/905] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:55 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:40:56.905111 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:56.905846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:56.914599 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:56.915444 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:56.915889 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:56.916596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:56.917058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:56.917490 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:57.077279 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:57.086486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:57.087945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:57.089110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-484c461c-e16d-4135-a777-b978554055b7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1727 microversion: 2.20 time: 0.189370 Aug 29 21:40:57.089671 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 441/906] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:56 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:40:57.112731 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c19abd6-44a9-4e50-ba8e-cd538f018045"}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:57.115886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:57.123089 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:57.123635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:57.124130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:57.124890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:57.125333 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:57.125752 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:57.441853 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dbca8d7d-d649-4f7a-942b-e1b39f1646a7 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333668 Aug 29 21:40:57.442461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 466/907] 10.222.0.90 () {62 vars in 1364 bytes} [Mon Aug 29 21:40:57 2022] POST /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-volume_attachments => generated 188 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:40:57.587367 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:57.587961 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:57.594334 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:57.594973 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:57.595418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:57.596119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:57.596570 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:57.597091 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:59.339501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4e29bc60-ed3c-4177-a224-cd2898c111c1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-volume_attachments/5c19abd6-44a9-4e50-ba8e-cd538f018045" status: 202 len: 0 microversion: 2.20 time: 1.756635 Aug 29 21:40:59.340494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 442/908] 10.222.0.90 () {60 vars in 1457 bytes} [Mon Aug 29 21:40:57 2022] DELETE /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-volume_attachments/5c19abd6-44a9-4e50-ba8e-cd538f018045 => generated 0 bytes in 1760 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:59.410116 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:40:59.410856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:59.418312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:59.418918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:59.419455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:59.420254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:59.420815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:59.421511 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:59.454162 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127069) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:40:59.528148 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0bec4b31-9421-45b0-9beb-6cd651d36259 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "POST /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/action" status: 202 len: 0 microversion: 2.20 time: 0.124016 Aug 29 21:40:59.528670 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 467/909] 10.222.0.90 () {62 vars in 1319 bytes} [Mon Aug 29 21:40:59 2022] POST /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:40:59.539274 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:40:59.539908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:40:59.545956 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:59.546619 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:59.547255 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:59.547950 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:40:59.548555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:40:59.549214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:40:59.703610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:59.714113 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:59.715662 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:40:59.716949 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-12756f5f-889f-42a6-afea-66cf3b98fa49 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1675 microversion: 2.20 time: 0.184012 Aug 29 21:40:59.717529 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 443/910] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:40:59 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:00.745071 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:00.746338 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:00.752462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:00.752959 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:00.753449 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:00.754695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:00.755147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:00.755573 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:00.902777 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:00.913530 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:00.915235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:00.916533 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-25c69361-5cc9-4138-b79c-f78037f4f894 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.178092 Aug 29 21:41:00.917375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 468/911] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:00 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:01.941412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:01.942051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:01.948548 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:01.949043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:01.949474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:01.950203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:01.950664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:01.951097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:02.134403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:02.149644 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:02.151229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:02.152420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5548ab67-fe5e-411d-90bb-bde79a06c105 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.215651 Aug 29 21:41:02.152988 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 444/912] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:01 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:03.115766 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:03.117165 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:03.125532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.126254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.127968 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.129471 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.130201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.131032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.183422 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:03.186036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:03.201537 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.202074 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.202502 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.203465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.203915 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.208375 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.290408 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'services' on Instance uuid 79710085-1445-4ccc-b0e8-9eceadb5a956 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:41:03.418288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:03.439167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-03d3b9dc-ec38-4d61-9bf0-2d332ae926ff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments/32523cc7-2608-43f2-a251-86517f72b674" status: 202 len: 0 microversion: 2.1 time: 0.328717 Aug 29 21:41:03.445653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 469/913] 10.222.0.90 () {58 vars in 1416 bytes} [Mon Aug 29 21:41:03 2022] DELETE /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments/32523cc7-2608-43f2-a251-86517f72b674 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:41:03.457932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:03.463445 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:03.471350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:03.478049 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.482823 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.484061 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.485044 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:03.487340 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:03.487834 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:03.488560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c8aaeb69-68bd-460b-9ab0-1181e33ac242 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.313623 Aug 29 21:41:03.488689 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:03.489119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 445/914] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:03 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:41:03.503804 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:03.573448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-cba15b12-2629-4748-8257-f477f6c000e3 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126380 Aug 29 21:41:03.576899 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 470/915] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:03 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:04.518649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:04.520164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:04.527473 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:04.528258 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:04.528716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:04.529427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:04.529948 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:04.530379 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:04.588794 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:04.592343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:04.608127 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:04.608617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:04.609045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:04.609743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:04.610520 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:04.611155 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:04.648167 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-a1503988-7734-48c4-8d7d-9baff9008e13 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063413 Aug 29 21:41:04.649026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 471/916] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:04 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:04.706459 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:04.715178 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:04.717615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:04.719177 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-344c1ba9-1063-4da6-b6be-af69d3013e53 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.205174 Aug 29 21:41:04.719747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 446/917] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:04 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:05.661453 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:05.663864 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:05.670910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:05.671399 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:05.671832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:05.672536 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:05.672988 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:05.673410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:05.708607 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7632fab1-6e5d-4d6a-af7e-34fa2af9e34b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051628 Aug 29 21:41:05.709246 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 472/918] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:05 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:05.745354 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:05.746020 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:05.753114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:05.753597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:05.754203 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:05.754858 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:05.755315 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:05.755740 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:05.906337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:05.916710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:05.918122 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:05.919292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3ce3d63f-e582-49d4-ae60-e7e8042f143f tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.178301 Aug 29 21:41:05.919855 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 447/919] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:05 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:41:06.721447 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:06.724527 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:06.731423 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:06.732901 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:06.733949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:06.735195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:06.735824 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:06.736491 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:06.772599 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2c95bba6-d315-4082-86b3-b554a0137afb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055713 Aug 29 21:41:06.773475 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 473/920] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:06 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:06.946139 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:06.947145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:06.953984 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:06.954464 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:06.955802 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:06.956690 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:06.957722 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:06.958176 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:06.983101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:07.129475 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:07.139487 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:07.141220 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:07.142517 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-827e13c0-bb68-44e1-84e3-fc5be630e569 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.200579 Aug 29 21:41:07.143382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 448/921] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:06 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:07.787060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:07.790388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:07.797680 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:07.798194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:07.798626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:07.799328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:07.799986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:07.800404 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:07.844728 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-fc21a7f5-4b53-4fce-a90a-fae1bb354e15 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062696 Aug 29 21:41:07.845305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 474/922] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:07 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:08.170729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:08.171574 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:08.179185 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.179684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.180131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.181104 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.181311 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.181741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.351661 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:08.360365 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:08.362747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:08.363925 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-41800238-3f15-479e-88f0-2a730abcf6c6 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.197240 Aug 29 21:41:08.364924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 449/923] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:08 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:41:08.863266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:08.866345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:08.874791 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.875486 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.876092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.879108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:08.880018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:08.881022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:08.923211 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3cea1b8d-4a85-43cc-ba36-f9024135618c tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070286 Aug 29 21:41:08.930737 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 475/924] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:08 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:09.399361 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:09.400768 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:09.408876 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.409911 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.410647 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.411871 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.412604 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.413282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.576605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:09.590018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:09.594517 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:09.600127 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-c8d29d89-077f-4dd9-9ce8-670288a98f06 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.205595 Aug 29 21:41:09.601089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 450/925] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:09 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:09.940606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:09.943697 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:09.950752 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.951257 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.951696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.952409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:09.952867 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:09.953945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:09.992605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-936aac98-5612-493e-9985-53cd8e8ee4a9 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057493 Aug 29 21:41:09.993187 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 476/926] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:09 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:10.624953 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:10.625931 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:10.633750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:10.634277 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:10.634799 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:10.635522 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:10.635983 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:10.636411 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:10.808154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:10.822455 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:10.824017 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:10.825395 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4689be16-4afe-4e3a-8982-ebcb05f6271d tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.204630 Aug 29 21:41:10.826113 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 451/927] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:10 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:11.007836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:11.010052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:11.023281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:11.024448 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:11.025086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:11.026026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:11.026663 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:11.027289 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:11.085676 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-18317f39-79e9-4263-8901-ab704ea564c0 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082731 Aug 29 21:41:11.087214 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 477/928] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:11 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:11.862119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:11.863873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:11.870672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:11.872599 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:11.873106 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:11.874043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:11.874809 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:11.875242 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:12.049215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:12.060058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:12.061441 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:12.063290 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-864b18d4-bc44-4510-a32e-57d76c4cfa10 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.207567 Aug 29 21:41:12.064907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 452/929] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:11 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:12.102765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:12.105204 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:12.114117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:12.114117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:12.114117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:12.114628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:12.115815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:12.116291 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:12.177760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-77e2654d-7ea1-4747-b763-35893bb4fed7 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080495 Aug 29 21:41:12.178413 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 478/930] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:12 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:13.089447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:13.090122 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:13.092140 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=40 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:13.098286 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:13.098793 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:13.099238 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:13.099954 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:13.100415 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:13.100844 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:13.192918 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:13.197199 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:13.203160 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:13.203647 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:13.204081 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:13.204991 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:13.205493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:13.205973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:13.245175 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d56893c9-8c76-4d89-b336-d926db6be55e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057720 Aug 29 21:41:13.245763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 479/931] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:13 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:13.248992 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:13.258103 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:13.259621 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:13.260803 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a5861684-ad35-4e9b-96d4-8d727d2d19a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.175974 Aug 29 21:41:13.261370 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 453/932] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:13 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:14.258789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:14.261414 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:14.271366 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.271852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.272281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.273097 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.273499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.273917 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.284593 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:14.285413 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:14.293887 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.294690 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.295613 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.297070 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.297649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.298729 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.307296 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3b3bec74-6010-466f-8ed7-580af09b9689 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052890 Aug 29 21:41:14.307861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 480/933] 10.222.0.90 () {58 vars in 1302 bytes} [Mon Aug 29 21:41:14 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:41:14.388825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:14.389320 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:14.396795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.397539 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.398301 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.399253 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.399894 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.400479 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.429077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:41:14.462676 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:14.472227 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:14.474227 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:14.475747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-6762b536-587e-4243-bd76-fcd7a0962e4a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.195095 Aug 29 21:41:14.476451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 454/934] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:14 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:41:14.520793 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-9181ede0-ee82-4c5d-afab-2eb29414f0fb tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 204 len: 0 microversion: 2.1 time: 0.136033 Aug 29 21:41:14.524663 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 481/935] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:14 2022] DELETE /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:41:14.530132 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:14.530819 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:14.539631 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.540206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.540768 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.541616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:14.542101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:14.542540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:14.704047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:14.715170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-12b35928-4ce3-4c46-8891-2e2b0beb9b0b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1681 microversion: 2.1 time: 0.189137 Aug 29 21:41:14.715752 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 455/936] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:14 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:15.504596 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:15.505305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:15.513239 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:15.513928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:15.514375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:15.515235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:15.515681 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:15.516215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:15.660107 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:15.668643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:15.670124 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:15.671342 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7c240936-11fa-498b-a9a7-ec62406644de tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.172631 Aug 29 21:41:15.671910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 482/937] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:15 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:15.737533 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:15.738173 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:15.744817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:15.745391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:15.745741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:15.746469 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:15.746926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:15.747353 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:15.898347 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:15.906190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-09144c07-3abd-4b38-a453-b3bd2728fc53 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1681 microversion: 2.1 time: 0.173027 Aug 29 21:41:15.907101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 456/938] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:15 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:16.700142 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:16.701378 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:16.707077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:16.712231 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:16.713017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:16.714577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:16.715732 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:16.716686 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:16.717193 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:16.797597 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-3283395c-8a9e-48c9-97f6-545563e68e16 req-87d5ae1b-a788-4538-9b5a-68f62771ab0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc41e68-4172-413f-bb4f-08e5b1bc1b70", "name": "network-vif-plugged", "status": "completed", "tag": "84e78a81-6684-42c4-bd59-4c45cc70b49e"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:16.809219 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-3283395c-8a9e-48c9-97f6-545563e68e16 req-87d5ae1b-a788-4538-9b5a-68f62771ab0e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:16.809711 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-3283395c-8a9e-48c9-97f6-545563e68e16 req-87d5ae1b-a788-4538-9b5a-68f62771ab0e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:16.810196 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-3283395c-8a9e-48c9-97f6-545563e68e16 req-87d5ae1b-a788-4538-9b5a-68f62771ab0e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:16.825605 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-3283395c-8a9e-48c9-97f6-545563e68e16 req-87d5ae1b-a788-4538-9b5a-68f62771ab0e service nova] Creating event network-vif-plugged:84e78a81-6684-42c4-bd59-4c45cc70b49e for instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 on hv-cinder-85426 Aug 29 21:41:16.832863 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-3283395c-8a9e-48c9-97f6-545563e68e16 req-87d5ae1b-a788-4538-9b5a-68f62771ab0e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039040 Aug 29 21:41:16.834004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 457/939] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:16.932240 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:16.933182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:16.944620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:16.946901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:16.947549 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:16.951998 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:16.952996 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:16.965878 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:17.034714 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:17.054398 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:17.056855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:17.059218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0bfd67f2-3e57-4096-9f9a-eff601099a69 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.366305 Aug 29 21:41:17.059795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 483/940] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:16 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:17.326171 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:17.334824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3427e3d2-ebd4-4398-b5b2-8d11bfa0c4aa tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1681 microversion: 2.1 time: 0.409726 Aug 29 21:41:17.335511 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 458/941] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:16 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1681 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:17.852954 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-1ba99ffc-917d-49ee-bcdb-22b1fefa1c69 req-058a5f67-c9f7-42e7-bf49-ecd3a5646f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79710085-1445-4ccc-b0e8-9eceadb5a956", "name": "network-vif-deleted", "tag": "8a9dc579-27fb-4534-8725-09a41e317d71"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:17.865032 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-1ba99ffc-917d-49ee-bcdb-22b1fefa1c69 req-058a5f67-c9f7-42e7-bf49-ecd3a5646f8b service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:17.865724 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-1ba99ffc-917d-49ee-bcdb-22b1fefa1c69 req-058a5f67-c9f7-42e7-bf49-ecd3a5646f8b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:17.866452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-1ba99ffc-917d-49ee-bcdb-22b1fefa1c69 req-058a5f67-c9f7-42e7-bf49-ecd3a5646f8b service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:17.880269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-1ba99ffc-917d-49ee-bcdb-22b1fefa1c69 req-058a5f67-c9f7-42e7-bf49-ecd3a5646f8b service nova] Creating event network-vif-deleted:8a9dc579-27fb-4534-8725-09a41e317d71 for instance 79710085-1445-4ccc-b0e8-9eceadb5a956 on hv-cinder-85426 Aug 29 21:41:17.885670 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-1ba99ffc-917d-49ee-bcdb-22b1fefa1c69 req-058a5f67-c9f7-42e7-bf49-ecd3a5646f8b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Aug 29 21:41:17.886612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 484/942] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:18.083848 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:18.084457 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:18.091569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:18.092061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:18.092502 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:18.093215 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:18.093672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:18.094146 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:18.321688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:18.335836 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:18.338036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:18.340629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-71bea88d-3769-48d6-9c22-a96fe17b791b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.261560 Aug 29 21:41:18.342884 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 459/943] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:18 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:18.369835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:18.374513 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:18.398683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:18.399173 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:18.399603 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:18.400306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:18.400769 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:18.401189 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:18.418834 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:18.443459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:18.444165 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:18.444744 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:18.445324 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid 79710085-1445-4ccc-b0e8-9eceadb5a956 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:41:18.505642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:18.520734 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f21a6e8f-c8b1-44b8-8d80-a0473dfc6905 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1331 microversion: 2.1 time: 0.166335 Aug 29 21:41:18.521534 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 485/944] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:18 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:19.386516 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:19.389499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:19.400428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:19.402638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:19.403759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:19.405420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:19.406798 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:19.407471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:19.545410 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:19.546056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:19.554558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:19.555133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:19.555985 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:19.556830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:19.557137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:19.557556 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:19.608533 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:19.609180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:19.609729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:19.611451 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lazy-loading 'fault' on Instance uuid 79710085-1445-4ccc-b0e8-9eceadb5a956 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:41:19.647111 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:19.662678 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:19.666365 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbbfb39899b04668ac1b7ff28d18e839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c829bce41c4be9a0027076ef0ace75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:19.674175 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-644b7511-72bb-4f81-9d4b-3285a5040308 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 200 len: 1331 microversion: 2.1 time: 0.133788 Aug 29 21:41:19.674687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:19.675418 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 486/945] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:19 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:19.676193 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ac86f990-c1b8-46bc-8a5a-31452e12a65a tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1733 microversion: 2.20 time: 0.294510 Aug 29 21:41:19.676854 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 460/946] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:19 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1733 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:20.697542 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:20.698949 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:20.700288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:20.700846 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:20.706184 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:20.706871 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:20.707464 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:20.708207 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:20.708357 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:20.708932 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:20.709128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:20.709354 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:20.709738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:20.710610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:20.711230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:20.711852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:20.725259 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 HTTP/1.1 Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:41:20.726892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:20.728432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '79710085-1445-4ccc-b0e8-9eceadb5a956'} Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:20.729300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:20.730817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:20.732044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:20.732044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2d5b1503-c59f-4104-9e59-ca614d849085 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 404 len: 111 microversion: 2.1 time: 0.034669 Aug 29 21:41:20.732044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 487/947] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:20 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:20.740179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-0fd98bfc-7b48-4be0-a757-763faa607516 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '.version_select at 0x7f8bdf95c280>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:20.764041 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-0fd98bfc-7b48-4be0-a757-763faa607516 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645324035" status: 202 len: 0 microversion: 2.1 time: 0.030620 Aug 29 21:41:20.765614 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 488/948] 10.222.0.90 () {58 vars in 1221 bytes} [Mon Aug 29 21:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645324035 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:41:20.927780 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:20.937226 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:20.939873 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:20.941257 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b2d75b08-0c6e-4881-bf16-3ab3da933a6e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1720 microversion: 2.20 time: 0.244817 Aug 29 21:41:20.942006 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 461/949] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:20 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:41:22.918196 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:22.918835 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:22.930305 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:22.931350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:22.932013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:22.932979 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:22.933650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:22.934104 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:22.948733 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 HTTP/1.1 Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:41:22.950337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.951921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '79710085-1445-4ccc-b0e8-9eceadb5a956'} Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:22.956226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.957738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.959335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:22.959335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-019c3896-ccc6-4d19-8e45-6dfbf65d1d06 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 404 len: 111 microversion: 2.1 time: 0.038505 Aug 29 21:41:22.959335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 489/950] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:22 2022] DELETE /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:22.963836 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:22.964600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 79710085-1445-4ccc-b0e8-9eceadb5a956] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:22.971982 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:22.972546 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:22.973208 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:22.974037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:22.974564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:22.975066 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:22.992668 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 HTTP/1.1 Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:41:22.994348 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.995725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '79710085-1445-4ccc-b0e8-9eceadb5a956'} Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:22.996611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. Aug 29 21:41:22.998508 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:23.000323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance 79710085-1445-4ccc-b0e8-9eceadb5a956 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:23.000323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0d9a9f65-0c3b-4cfc-8b88-021cae861b1e tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956" status: 404 len: 111 microversion: 2.1 time: 0.036666 Aug 29 21:41:23.000323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 462/951] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:22 2022] GET /compute/v2.1/servers/79710085-1445-4ccc-b0e8-9eceadb5a956 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:24.159411 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:24.160393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:24.169431 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.170269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.171022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.172950 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.174300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.175065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.197826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 HTTP/1.1 Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:41:24.199521 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.201137 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': 'ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1'} Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:24.202206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.203984 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.205520 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:24.205520 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-3c56afda-ca53-42a0-a8d0-abd5f556aeff tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 404 len: 111 microversion: 2.1 time: 0.046720 Aug 29 21:41:24.205520 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 490/952] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:24 2022] DELETE /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:24.210740 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:24.212066 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:24.219409 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.219890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.220414 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.221294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.221750 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.222199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.237428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 HTTP/1.1 Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:41:24.239209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.241059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1'} Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:24.241963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. Aug 29 21:41:24.243465 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.244758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:24.244758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-955f1fff-e210-4eee-9949-bcb043db59c1 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1" status: 404 len: 111 microversion: 2.1 time: 0.033952 Aug 29 21:41:24.244758 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 463/953] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:24 2022] GET /compute/v2.1/servers/ff9ccbdb-04c5-48c7-9d6d-4b19c1359ac1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:41:24.250279 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:24.250770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:24.258194 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.258750 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.259424 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.260215 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.260865 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.261336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.275166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e HTTP/1.1 Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:41:24.276708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.278312 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '416273e0-c330-4270-ac80-9bfbb9ded49e'} Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:24.279152 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.280416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.281675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:24.281675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5afcdb7c-75b9-4a81-b550-f0ac8592142b tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 404 len: 111 microversion: 2.1 time: 0.031940 Aug 29 21:41:24.281675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 491/954] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:24 2022] DELETE /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:24.288004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:24.288827 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: 416273e0-c330-4270-ac80-9bfbb9ded49e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:24.295037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.295524 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.295964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.296656 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:24.297116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:24.297540 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:24.311639 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e HTTP/1.1 Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:41:24.313618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.316021 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '416273e0-c330-4270-ac80-9bfbb9ded49e'} Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:24.319971 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. Aug 29 21:41:24.321560 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:24.322883 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance 416273e0-c330-4270-ac80-9bfbb9ded49e could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:24.322883 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-642644a7-b2d4-40e7-8442-2501414377d4 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e" status: 404 len: 111 microversion: 2.1 time: 0.032210 Aug 29 21:41:24.322883 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 464/955] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:24 2022] GET /compute/v2.1/servers/416273e0-c330-4270-ac80-9bfbb9ded49e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:25.492830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:25.493419 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:25.499767 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:25.500269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:25.500684 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:25.501417 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:25.501910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:25.502531 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:25.519694 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 HTTP/1.1 Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:41:25.521350 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.522798 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': 'd85c8e78-15e9-492f-b705-c725ff867ed0'} Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:25.523572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.524817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.526093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:25.526093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e5199265-a00a-41a5-89bb-58d659cc5700 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 404 len: 111 microversion: 2.1 time: 0.034014 Aug 29 21:41:25.526093 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 492/956] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:25 2022] DELETE /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:41:25.531596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:25.532226 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] [instance: d85c8e78-15e9-492f-b705-c725ff867ed0] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:25.541059 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:25.541551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:25.542015 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:25.542708 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:25.544412 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:25.544924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:25.564613 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] HTTP exception thrown: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Request method failure captured: Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 HTTP/1.1 Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTDQyJbZ7DsUOM5CXMuYz-x1C27qSWD6zQiYksFkVJXX-mzJylIW9Sr60T-PiZH__9_n7jheZYep2fJhkIRzdQVx_mRwAk8oTUCKqXjD4Ma7xlJJL-0rlSZxsRnn0mEGWZrArHrt05coyq2EdHA6zlNTnX5URsPLg8DoX6s4FE1EYXc Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:41:25.566288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d3c829bce41c4be9a0027076ef0ace75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d3c829bce41c4be9a0027076ef0ace75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: d3c829bce41c4be9a0027076ef0ace75 Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-581587509 Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: bbbfb39899b04668ac1b7ff28d18e839 Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeNegativeTest-581587509-project Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.567747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'd85c8e78-15e9-492f-b705-c725ff867ed0'} Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:25.568638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. Aug 29 21:41:25.569962 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:25.571138 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] Returning 404 to user: Instance d85c8e78-15e9-492f-b705-c725ff867ed0 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:25.571138 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ac9cd9cf-3d83-4d56-92fd-e492a7a05403 tempest-AttachVolumeNegativeTest-581587509 tempest-AttachVolumeNegativeTest-581587509-project] 10.222.0.90 "GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0" status: 404 len: 111 microversion: 2.1 time: 0.040022 Aug 29 21:41:25.571138 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 465/957] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:25 2022] GET /compute/v2.1/servers/d85c8e78-15e9-492f-b705-c725ff867ed0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:26.372582 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-132384553", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "networks": [{"uuid": "636ca84e-9230-45ba-8ef3-b05d7f6ff55c"}]}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:26.430466 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] validate_networks() for [('636ca84e-9230-45ba-8ef3-b05d7f6ff55c', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:41:26.853978 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:41:26.858407 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:41:26.859608 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:41:26.860250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:41:26.864914 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:41:26.877630 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:26.878743 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:26.879343 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:26.880442 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:26.880971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:26.881514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:26.906208 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Getting quotas for project 902c413d242b4ff7a556c7e487ef5e90. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:41:26.911894 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Getting quotas for user 7952b085a8b94dcbbeb6a2817ad602e9 and project 902c413d242b4ff7a556c7e487ef5e90. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:41:26.925138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:41:26.927661 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:41:26.984059 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-964a9918-583a-4af1-9764-7ce0a9258d3c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615141 Aug 29 21:41:26.991682 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 493/958] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:41:26.997460 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-7302c776-3f6f-4f90-8a99-9ceb7fc642a7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:26.998754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-7302c776-3f6f-4f90-8a99-9ceb7fc642a7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:27.079110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-7302c776-3f6f-4f90-8a99-9ceb7fc642a7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:27.088406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-7302c776-3f6f-4f90-8a99-9ceb7fc642a7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1213 microversion: 2.1 time: 0.095422 Aug 29 21:41:27.089769 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 466/959] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:26 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:28.111379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:28.111379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:28.117849 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:28.118324 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:28.118765 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:28.119478 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:28.119955 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:28.120464 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:28.193698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:28.202138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1f4c2746-73f3-4a0e-ab2c-71c24bf1cdbc tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1265 microversion: 2.1 time: 0.095813 Aug 29 21:41:28.203099 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 494/960] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:28 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:29.227119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:29.227924 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:29.235935 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:29.236534 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:29.237196 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:29.238213 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:29.238880 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:29.239603 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:29.508694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:29.521967 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9f323ec7-0157-4d81-b74e-1532a28cdde9 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1313 microversion: 2.1 time: 0.300575 Aug 29 21:41:29.524263 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 467/961] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:29 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:30.084165 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-e801aff4-1cd7-47f5-8b07-f715d591acb5 req-3fa40e6e-9211-4eec-8e97-acc9b37cf2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d67bd5-5de0-4c8e-864e-dc52c9115b1b", "tag": "5f15b89d-3b63-4ba1-8e75-72a6191ae20c"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:30.105438 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-e801aff4-1cd7-47f5-8b07-f715d591acb5 req-3fa40e6e-9211-4eec-8e97-acc9b37cf2f9 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:30.106862 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-e801aff4-1cd7-47f5-8b07-f715d591acb5 req-3fa40e6e-9211-4eec-8e97-acc9b37cf2f9 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:30.108381 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-e801aff4-1cd7-47f5-8b07-f715d591acb5 req-3fa40e6e-9211-4eec-8e97-acc9b37cf2f9 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:30.129548 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-e801aff4-1cd7-47f5-8b07-f715d591acb5 req-3fa40e6e-9211-4eec-8e97-acc9b37cf2f9 service nova] Creating event network-changed:5f15b89d-3b63-4ba1-8e75-72a6191ae20c for instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b on hv-cinder-85426 Aug 29 21:41:30.139353 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-e801aff4-1cd7-47f5-8b07-f715d591acb5 req-3fa40e6e-9211-4eec-8e97-acc9b37cf2f9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065412 Aug 29 21:41:30.141675 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 495/962] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:30.546145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:30.546775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:30.555282 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:30.556089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:30.556693 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:30.557586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:30.561075 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:30.561823 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:30.795006 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:30.806017 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cc4f6225-e717-4765-8b15-cbfbd309b494 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1313 microversion: 2.1 time: 0.263869 Aug 29 21:41:30.806945 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 468/963] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:30 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:31.829150 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:31.830702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:31.837555 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:31.838288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:31.838890 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:31.839763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:31.840382 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:31.840997 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:32.024403 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:32.040095 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b27b00b2-d65d-47b9-8d5f-0b1ac3b9868e tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1313 microversion: 2.1 time: 0.215281 Aug 29 21:41:32.040729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 496/964] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:31 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:33.061770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:33.062401 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:33.069941 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:33.070433 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:33.071305 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:33.071625 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:33.072149 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:33.072567 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:33.094392 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=100 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:33.227656 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:33.236415 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ed3247f6-2e45-49db-b437-c296fe072b99 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1313 microversion: 2.1 time: 0.178424 Aug 29 21:41:33.237418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 469/965] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:33 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:34.257941 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:34.258515 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:34.264913 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:34.265394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:34.265856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:34.267421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:34.267973 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:34.268539 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:34.416848 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:34.425023 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f6e17591-5107-41c7-acbd-b50def613982 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1313 microversion: 2.1 time: 0.171041 Aug 29 21:41:34.425593 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 497/966] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:34 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:34.962158 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-5621e1b8-cadc-42c1-beb1-d2277f2f220b req-f2e220ce-86c4-4ddf-b9b5-a8b1a266d624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d67bd5-5de0-4c8e-864e-dc52c9115b1b", "name": "network-vif-plugged", "status": "completed", "tag": "5f15b89d-3b63-4ba1-8e75-72a6191ae20c"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:34.974684 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-5621e1b8-cadc-42c1-beb1-d2277f2f220b req-f2e220ce-86c4-4ddf-b9b5-a8b1a266d624 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:34.975169 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-5621e1b8-cadc-42c1-beb1-d2277f2f220b req-f2e220ce-86c4-4ddf-b9b5-a8b1a266d624 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:34.975601 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-5621e1b8-cadc-42c1-beb1-d2277f2f220b req-f2e220ce-86c4-4ddf-b9b5-a8b1a266d624 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:34.988653 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-5621e1b8-cadc-42c1-beb1-d2277f2f220b req-f2e220ce-86c4-4ddf-b9b5-a8b1a266d624 service nova] Creating event network-vif-plugged:5f15b89d-3b63-4ba1-8e75-72a6191ae20c for instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b on hv-cinder-85426 Aug 29 21:41:34.994124 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-5621e1b8-cadc-42c1-beb1-d2277f2f220b req-f2e220ce-86c4-4ddf-b9b5-a8b1a266d624 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Aug 29 21:41:34.994909 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 470/967] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:35.445879 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:35.447242 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:35.454850 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:35.455525 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:35.456029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:35.456851 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:35.457307 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:35.457939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:35.617191 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:35.624983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-56438318-04fa-4c6f-aef9-27f16f229463 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1313 microversion: 2.1 time: 0.182895 Aug 29 21:41:35.626375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 498/968] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:35 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:36.647283 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:36.647994 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:36.654405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:36.654902 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:36.655368 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:36.656048 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:36.656505 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:36.657335 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:36.803051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:36.811140 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cf8242e8-3627-4223-aee8-47fe587b18ec tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1497 microversion: 2.1 time: 0.168707 Aug 29 21:41:36.811754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 471/969] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:36 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:37.227374 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:37.227995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:37.231614 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:37.232443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:37.238384 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:37.238872 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:37.239303 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:37.240022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:37.240425 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:37.240842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:37.277669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:41:37.360886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4d07ff4d-8a62-4e75-a7c7-b074a39aa819 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 204 len: 0 microversion: 2.1 time: 0.136576 Aug 29 21:41:37.361569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 499/970] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:37 2022] DELETE /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:41:37.371527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:37.372145 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:37.374166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:37.379979 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:37.380470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:37.380910 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:37.381606 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:37.382089 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:37.382524 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:37.521590 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:37.529900 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-49b27f40-221c-4cc4-811b-9d1052df8686 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1503 microversion: 2.1 time: 0.162207 Aug 29 21:41:37.530451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 472/971] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:37 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:38.551744 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:38.552465 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:38.558555 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:38.559029 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:38.559459 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:38.560133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:38.560575 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:38.561192 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:38.750201 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:38.758796 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-937c434e-438b-4b04-b7af-3f52a1c46b72 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1503 microversion: 2.1 time: 0.211521 Aug 29 21:41:38.759379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 500/972] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:38 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:39.784725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:39.785689 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:39.794672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:39.795335 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:39.796008 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:39.796787 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:39.797270 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:39.797702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:39.898861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:39.907000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-3ced1b23-71fc-447b-a15e-5a9f05e0de15 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 200 len: 1461 microversion: 2.1 time: 0.130635 Aug 29 21:41:39.922039 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 473/973] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:39 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 1461 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:39.926086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-7220fcd3-bdd2-4d65-80b1-bf53428d5b2a req-008b3d66-2db7-4a9c-8ed2-c3f07b0aa5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d67bd5-5de0-4c8e-864e-dc52c9115b1b", "name": "network-vif-deleted", "tag": "5f15b89d-3b63-4ba1-8e75-72a6191ae20c"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:39.952787 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7220fcd3-bdd2-4d65-80b1-bf53428d5b2a req-008b3d66-2db7-4a9c-8ed2-c3f07b0aa5d3 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:39.954041 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7220fcd3-bdd2-4d65-80b1-bf53428d5b2a req-008b3d66-2db7-4a9c-8ed2-c3f07b0aa5d3 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:39.955306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-7220fcd3-bdd2-4d65-80b1-bf53428d5b2a req-008b3d66-2db7-4a9c-8ed2-c3f07b0aa5d3 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:39.971047 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-7220fcd3-bdd2-4d65-80b1-bf53428d5b2a req-008b3d66-2db7-4a9c-8ed2-c3f07b0aa5d3 service nova] Creating event network-vif-deleted:5f15b89d-3b63-4ba1-8e75-72a6191ae20c for instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b on hv-cinder-85426 Aug 29 21:41:39.978092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-7220fcd3-bdd2-4d65-80b1-bf53428d5b2a req-008b3d66-2db7-4a9c-8ed2-c3f07b0aa5d3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056585 Aug 29 21:41:39.978700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 501/974] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:40.929765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:40.931002 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: e4d67bd5-5de0-4c8e-864e-dc52c9115b1b] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:40.937162 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:40.937658 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:40.938152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:40.939195 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:40.939905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:40.940510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:40.955543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] HTTP exception thrown: Instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b could not be found. Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Request method failure captured: Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b HTTP/1.1 Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTKEjiBmFvE-AyyRZKlLIG2UcSYfd2Mkg2SMa4nBe-LUgi7EqiY_3Uzo_ejh_XVDH5mEEkVu8Nk38m7ILBjaeBCBvgVXCeSw4ZPyPa-wUGcWsuTmovHb18bEkKJDTlAMDD3yQFFjwoeVuYn777CmuJDWtrl_zL9VT4x4-T-554EoXIg Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 902c413d242b4ff7a556c7e487ef5e90 Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-VolumesActionsTest-1543687495 Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:41:40.957224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/902c413d242b4ff7a556c7e487ef5e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/902c413d242b4ff7a556c7e487ef5e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/902c413d242b4ff7a556c7e487ef5e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_902c413d242b4ff7a556c7e487ef5e90", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-VolumesActionsTest-1543687495 Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 902c413d242b4ff7a556c7e487ef5e90 Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-VolumesActionsTest-1543687495 Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-VolumesActionsTest-1543687495-project Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 7952b085a8b94dcbbeb6a2817ad602e9 Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-VolumesActionsTest-1543687495-project Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b could not be found. Aug 29 21:41:40.958977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': 'e4d67bd5-5de0-4c8e-864e-dc52c9115b1b'} Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b could not be found. Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:40.960229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b could not be found. Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b could not be found. Aug 29 21:41:40.961759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:41:40.963860 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Returning 404 to user: Instance e4d67bd5-5de0-4c8e-864e-dc52c9115b1b could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:40.964717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-bebca803-5b46-49d5-aa7d-2feed2e46474 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b" status: 404 len: 111 microversion: 2.1 time: 0.039349 Aug 29 21:41:40.965276 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 474/975] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:40 2022] GET /compute/v2.1/servers/e4d67bd5-5de0-4c8e-864e-dc52c9115b1b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:41.074689 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-821289854", "imageRef": "764b6f8b-bc76-4bcd-ae26-e22127716760", "flavorRef": "452", "networks": [{"uuid": "636ca84e-9230-45ba-8ef3-b05d7f6ff55c"}]}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:41.137551 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] validate_networks() for [('636ca84e-9230-45ba-8ef3-b05d7f6ff55c', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:41:41.516964 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:41:41.517632 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:41:41.518291 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:41:41.518867 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:41:41.519395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:41:41.528989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:41.529667 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:41.530138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:41.530889 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:41.531336 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:41.531756 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:41.550260 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Getting quotas for project 902c413d242b4ff7a556c7e487ef5e90. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:41:41.554643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Getting quotas for user 7952b085a8b94dcbbeb6a2817ad602e9 and project 902c413d242b4ff7a556c7e487ef5e90. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:41:41.566393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:41:41.568977 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='764b6f8b-bc76-4bcd-ae26-e22127716760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:41:41.621114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-09d14815-f1b1-4493-bc71-65c0723bef5c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550862 Aug 29 21:41:41.621963 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 502/976] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:41:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:41:41.632847 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5e5d6a49-9845-46b2-a560-045033b284c5 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:41.633557 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5e5d6a49-9845-46b2-a560-045033b284c5 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:41.709039 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5e5d6a49-9845-46b2-a560-045033b284c5 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:41.716898 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5e5d6a49-9845-46b2-a560-045033b284c5 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1213 microversion: 2.1 time: 0.088035 Aug 29 21:41:41.717731 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 475/977] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:41 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:42.739671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:42.740254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:42.747238 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:42.747927 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:42.748642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:42.749557 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:42.750188 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:42.750763 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:42.850400 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:42.859383 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b4fbfb45-18ab-4665-aa15-29a3f2dc59ac tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1265 microversion: 2.1 time: 0.124621 Aug 29 21:41:42.861840 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 503/978] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:42 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:43.886933 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:43.887552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:43.889969 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=50 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:43.898858 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:43.899659 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:43.900284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:43.900993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:43.902262 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:43.902985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:44.149415 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:44.157249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-5abdc267-7267-487e-9272-53a2a048293c tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1313 microversion: 2.1 time: 0.274232 Aug 29 21:41:44.158110 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 476/979] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:43 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:44.222578 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-b41215f9-457f-4b9e-869a-11f638119dee req-2fdc9a59-043c-4abc-83e0-b8c763f5f818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ecb0fad-f47d-44a4-b039-41bcbc53cb2c", "tag": "fb804341-7e5d-4791-b4ee-114371d9b34b"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:44.238801 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-b41215f9-457f-4b9e-869a-11f638119dee req-2fdc9a59-043c-4abc-83e0-b8c763f5f818 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:44.239847 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-b41215f9-457f-4b9e-869a-11f638119dee req-2fdc9a59-043c-4abc-83e0-b8c763f5f818 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:44.240269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-b41215f9-457f-4b9e-869a-11f638119dee req-2fdc9a59-043c-4abc-83e0-b8c763f5f818 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:44.253840 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-b41215f9-457f-4b9e-869a-11f638119dee req-2fdc9a59-043c-4abc-83e0-b8c763f5f818 service nova] Creating event network-changed:fb804341-7e5d-4791-b4ee-114371d9b34b for instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c on hv-cinder-85426 Aug 29 21:41:44.262099 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-b41215f9-457f-4b9e-869a-11f638119dee req-2fdc9a59-043c-4abc-83e0-b8c763f5f818 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044791 Aug 29 21:41:44.262696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 504/980] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:45.178933 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:45.179593 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:45.186420 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:45.186905 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:45.187342 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:45.188030 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:45.188539 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:45.189602 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:45.324423 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:45.332717 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2a692346-72e6-4377-b29d-b7c6cb33b381 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1313 microversion: 2.1 time: 0.157726 Aug 29 21:41:45.333284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 477/981] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:45 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:46.355755 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:46.356479 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:46.363572 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:46.364053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:46.364493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:46.365181 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:46.365637 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:46.366129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:46.497208 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:46.505579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-d8950854-4c95-4e4f-b33d-30360a499e07 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1313 microversion: 2.1 time: 0.154062 Aug 29 21:41:46.506177 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 505/982] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:46 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:47.526339 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:47.526918 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:47.533499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:47.534018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:47.534451 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:47.535246 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:47.535698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:47.536116 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:47.671576 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:47.679759 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e5853f1e-0fa3-4cfb-9c7e-835fdf0f1dc1 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1313 microversion: 2.1 time: 0.157295 Aug 29 21:41:47.680356 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 478/983] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:47 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:41:48.700779 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:48.701388 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:48.704092 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:48.710077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:48.710556 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:48.710990 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:48.711692 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:48.712183 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:48.712607 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:48.716147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:48.867262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:48.885644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-75e928f0-edeb-4f0c-a670-1815ef0fcc50 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1313 microversion: 2.1 time: 0.188660 Aug 29 21:41:48.897997 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 506/984] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:48 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:48.913496 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-889ae562-4d68-434f-9b99-b7f309b72818 req-e8f5674e-8a13-4c68-a174-b6f99185e8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecb0fad-f47d-44a4-b039-41bcbc53cb2c", "name": "network-vif-plugged", "status": "completed", "tag": "fb804341-7e5d-4791-b4ee-114371d9b34b"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:48.925424 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-889ae562-4d68-434f-9b99-b7f309b72818 req-e8f5674e-8a13-4c68-a174-b6f99185e8d4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:48.925938 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-889ae562-4d68-434f-9b99-b7f309b72818 req-e8f5674e-8a13-4c68-a174-b6f99185e8d4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:48.926399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-889ae562-4d68-434f-9b99-b7f309b72818 req-e8f5674e-8a13-4c68-a174-b6f99185e8d4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:48.937557 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-889ae562-4d68-434f-9b99-b7f309b72818 req-e8f5674e-8a13-4c68-a174-b6f99185e8d4 service nova] Creating event network-vif-plugged:fb804341-7e5d-4791-b4ee-114371d9b34b for instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c on hv-cinder-85426 Aug 29 21:41:48.943523 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-889ae562-4d68-434f-9b99-b7f309b72818 req-e8f5674e-8a13-4c68-a174-b6f99185e8d4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035957 Aug 29 21:41:48.944154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 479/985] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:49.908462 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:49.909074 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:49.916233 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:49.916757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:49.917198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:49.917999 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:49.918859 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:49.919700 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:50.057103 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:50.066328 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1bd43360-5ab0-41a3-b9b6-3ecfc4c88890 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1313 microversion: 2.1 time: 0.162402 Aug 29 21:41:50.067209 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 507/986] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:49 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:51.088862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:51.089588 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:51.096518 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:51.096997 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:51.097430 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:51.098150 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:51.098609 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:51.099031 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:51.228448 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:51.236199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-363ecabb-6d36-47af-a45c-be879938cbe8 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1497 microversion: 2.1 time: 0.151961 Aug 29 21:41:51.236776 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 480/987] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:51 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:51.666820 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:51.667471 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:51.670243 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:51.671073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:51.677980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:51.678457 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:51.678886 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:51.679571 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:51.680018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:51.680433 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:51.706942 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:41:51.790830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-01b745b7-32ad-4ab4-b13d-c3ce1ec6e947 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 204 len: 0 microversion: 2.1 time: 0.127324 Aug 29 21:41:51.792139 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 508/988] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:41:51 2022] DELETE /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:41:51.802288 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:51.802903 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:51.804894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:51.810402 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:51.810894 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:51.811328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:51.812016 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:51.812468 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:51.812889 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:51.970943 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:51.979194 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-4a952a1e-cbd5-4b46-93ef-f17c29d65c82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1503 microversion: 2.1 time: 0.182702 Aug 29 21:41:51.979774 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 481/989] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:51 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:53.001825 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:53.002683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:53.009570 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.010176 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.010687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.011456 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.012004 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.012502 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.149453 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:53.158024 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-8ee58ca8-a68d-4ff1-bf17-d6960e9e4f82 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1503 microversion: 2.1 time: 0.161148 Aug 29 21:41:53.159347 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 509/990] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:52 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:53.701335 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-754e661a-7e4b-4fb8-b069-346e98c26c66 req-bada9b80-10b6-453b-bb1a-36e5b895ea91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ecb0fad-f47d-44a4-b039-41bcbc53cb2c", "name": "network-vif-deleted", "tag": "fb804341-7e5d-4791-b4ee-114371d9b34b"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:53.713272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-754e661a-7e4b-4fb8-b069-346e98c26c66 req-bada9b80-10b6-453b-bb1a-36e5b895ea91 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.723584 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-754e661a-7e4b-4fb8-b069-346e98c26c66 req-bada9b80-10b6-453b-bb1a-36e5b895ea91 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.724072 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-754e661a-7e4b-4fb8-b069-346e98c26c66 req-bada9b80-10b6-453b-bb1a-36e5b895ea91 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.739128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-754e661a-7e4b-4fb8-b069-346e98c26c66 req-bada9b80-10b6-453b-bb1a-36e5b895ea91 service nova] Creating event network-vif-deleted:fb804341-7e5d-4791-b4ee-114371d9b34b for instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c on hv-cinder-85426 Aug 29 21:41:53.744046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-754e661a-7e4b-4fb8-b069-346e98c26c66 req-bada9b80-10b6-453b-bb1a-36e5b895ea91 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046402 Aug 29 21:41:53.745479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 482/991] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:53.768337 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:53.770621 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:53.776705 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.777187 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.777623 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.778380 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.778834 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.779263 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.814436 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-5341dcce-3175-445f-9fd1-0e80cff0cd0c tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050983 Aug 29 21:41:53.815218 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 510/992] 10.222.0.90 () {60 vars in 1343 bytes} [Mon Aug 29 21:41:53 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:53.892410 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:53.893003 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:53.899328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.899817 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.900254 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:53.900943 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:53.901395 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:53.901845 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:54.083571 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:41:54.168793 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-210c8237-c140-49e3-b22f-d3a3d6c739a5 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 204 len: 0 microversion: 2.20 time: 0.280913 Aug 29 21:41:54.169643 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 483/993] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 21:41:53 2022] DELETE /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:41:54.180754 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:54.181366 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:54.181892 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:54.182225 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:54.189830 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:54.190542 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:54.190900 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:54.191097 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:54.191567 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:54.191748 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:54.192022 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:54.192258 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:54.192447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:54.193234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:54.193852 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:54.194332 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:54.245815 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:54.246494 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:54.247094 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:54.247608 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lazy-loading 'fault' on Instance uuid 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:41:54.312090 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7952b085a8b94dcbbeb6a2817ad602e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '902c413d242b4ff7a556c7e487ef5e90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:54.326469 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-020425e1-ae62-4491-8570-a7b85eb53fd7 tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 200 len: 1303 microversion: 2.1 time: 0.149851 Aug 29 21:41:54.327416 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 511/994] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:54 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:41:54.399677 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:54.408845 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:54.410391 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:54.411773 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0471b31e-caca-497c-87cd-6d13cc90bd48 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.235616 Aug 29 21:41:54.412359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 484/995] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:54 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:55.362046 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:55.362826 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] [instance: 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:55.370730 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:55.371314 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:55.371844 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:55.372636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:55.373216 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:55.373703 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:55.387605 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] HTTP exception thrown: Instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c could not be found. Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Request method failure captured: Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c HTTP/1.1 Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTKEjiBmFvE-AyyRZKlLIG2UcSYfd2Mkg2SMa4nBe-LUgi7EqiY_3Uzo_ejh_XVDH5mEEkVu8Nk38m7ILBjaeBCBvgVXCeSw4ZPyPa-wUGcWsuTmovHb18bEkKJDTlAMDD3yQFFjwoeVuYn777CmuJDWtrl_zL9VT4x4-T-554EoXIg Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 902c413d242b4ff7a556c7e487ef5e90 Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-VolumesActionsTest-1543687495 Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:41:55.389235 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/902c413d242b4ff7a556c7e487ef5e90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/902c413d242b4ff7a556c7e487ef5e90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/902c413d242b4ff7a556c7e487ef5e90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_902c413d242b4ff7a556c7e487ef5e90", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-VolumesActionsTest-1543687495 Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 902c413d242b4ff7a556c7e487ef5e90 Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-VolumesActionsTest-1543687495 Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-VolumesActionsTest-1543687495-project Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 7952b085a8b94dcbbeb6a2817ad602e9 Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-VolumesActionsTest-1543687495-project Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c could not be found. Aug 29 21:41:55.390980 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '8ecb0fad-f47d-44a4-b039-41bcbc53cb2c'} Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c could not be found. Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:41:55.392149 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c could not be found. Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c could not be found. Aug 29 21:41:55.393919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:41:55.395463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] Returning 404 to user: Instance 8ecb0fad-f47d-44a4-b039-41bcbc53cb2c could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:41:55.395463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-06710a2d-d9b1-4977-9062-629368d8393b tempest-VolumesActionsTest-1543687495 tempest-VolumesActionsTest-1543687495-project] 10.222.0.90 "GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c" status: 404 len: 111 microversion: 2.1 time: 0.034039 Aug 29 21:41:55.395463 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 512/996] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:41:55 2022] GET /compute/v2.1/servers/8ecb0fad-f47d-44a4-b039-41bcbc53cb2c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:41:55.438162 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:55.440206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:55.450710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:55.451343 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:55.452471 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:55.453240 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:55.453778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:55.454398 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:55.690306 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:55.702473 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:55.704636 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:55.706383 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-803baff1-dcaf-4f6d-ab73-811e44c87c65 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1726 microversion: 2.20 time: 0.274090 Aug 29 21:41:55.707074 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 485/997] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:55 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:56.730108 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:56.730834 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:56.737934 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:56.738445 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:56.738869 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:56.739558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:56.740002 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:56.740429 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:56.888326 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:56.899196 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:56.900804 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:56.902276 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-f75264ae-4c42-45d2-96b3-998dbe6c429e tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1658 microversion: 2.20 time: 0.176151 Aug 29 21:41:56.908353 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-28c20d7f-29f1-43e7-8fb5-d52a86885281 req-4e5a3110-54e0-4619-8abb-40d158301816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fc41e68-4172-413f-bb4f-08e5b1bc1b70", "name": "network-vif-deleted", "tag": "84e78a81-6684-42c4-bd59-4c45cc70b49e"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:41:56.918474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 513/998] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:56 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1658 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:56.924739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-28c20d7f-29f1-43e7-8fb5-d52a86885281 req-4e5a3110-54e0-4619-8abb-40d158301816 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:56.926232 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-28c20d7f-29f1-43e7-8fb5-d52a86885281 req-4e5a3110-54e0-4619-8abb-40d158301816 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:56.927495 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-28c20d7f-29f1-43e7-8fb5-d52a86885281 req-4e5a3110-54e0-4619-8abb-40d158301816 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:56.943868 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-28c20d7f-29f1-43e7-8fb5-d52a86885281 req-4e5a3110-54e0-4619-8abb-40d158301816 service nova] Creating event network-vif-deleted:84e78a81-6684-42c4-bd59-4c45cc70b49e for instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 on hv-cinder-85426 Aug 29 21:41:56.950184 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-28c20d7f-29f1-43e7-8fb5-d52a86885281 req-4e5a3110-54e0-4619-8abb-40d158301816 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046316 Aug 29 21:41:56.951195 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 486/999] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:41:57.927945 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:57.928566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:57.935106 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:57.935598 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:57.936038 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:57.936741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:57.937206 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:57.937836 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:58.021979 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:58.032524 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:58.034641 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:58.035908 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-515c1313-8bda-47f0-a564-4f3633c8dbf3 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1367 microversion: 2.20 time: 0.112032 Aug 29 21:41:58.037088 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 514/1000] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:57 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1367 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:41:59.060838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:59.067995 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:41:59.075843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:59.076338 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:59.079607 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:59.080359 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:59.080831 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:59.083416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:59.120857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:59.121252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:59.121694 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:59.122170 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lazy-loading 'fault' on Instance uuid 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:41:59.169407 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:59.180209 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:59.181665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6a3df8d796e4ae6ac358f103903d427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817ab3905c8541dc9c2bab51764984d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:41:59.182861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-418d5d1c-39a1-4ef2-9779-40c47e7c707b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 200 len: 1372 microversion: 2.20 time: 0.126899 Aug 29 21:41:59.183602 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 487/1001] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:41:59 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:42:00.215123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:00.215123 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:00.228635 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:00.229132 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:00.229622 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:00.230361 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:00.230817 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:00.231248 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:00.246353 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] HTTP exception thrown: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Request method failure captured: Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 HTTP/1.1 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTEXNtvQ844a-KGn93sePXbfSNoCBZ117LcTpj5lQT3li6RY0StyMWy3_18CxSBFcMnX6mLWcWi794RlJu3YsRd4vKIcGebK15uwHpNvGWQdZQ-OGc7teGojbBNL5PEsh0yZ8kKumgP74UofXMqpsx4wEpXfvnok91Nul7vwqNSnJG8 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:42:00.247888 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_817ab3905c8541dc9c2bab51764984d0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: b6a3df8d796e4ae6ac358f103903d427 Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:00.249391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '7fc41e68-4172-413f-bb4f-08e5b1bc1b70'} Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:42:00.251427 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:00.252966 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:00.255052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Returning 404 to user: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:42:00.255052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dbbd7b98-9f59-49a7-9cdc-a256b9f248a1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 404 len: 111 microversion: 2.20 time: 0.046504 Aug 29 21:42:00.255052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 515/1002] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:42:00 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:42:00.259735 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-27ed8631-4e11-41bd-9a8a-d2fa26fc42e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '.version_select at 0x7f8bdfc15a60>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:00.289252 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-27ed8631-4e11-41bd-9a8a-d2fa26fc42e1 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046843215" status: 204 len: 0 microversion: 2.20 time: 0.033484 Aug 29 21:42:00.290144 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 488/1003] 10.222.0.90 () {60 vars in 1262 bytes} [Mon Aug 29 21:42:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046843215 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:42:02.235421 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:02.236030 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:02.243037 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:02.243717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:02.244315 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:02.245198 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:02.245832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:02.246412 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:02.261006 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] HTTP exception thrown: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Request method failure captured: Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 HTTP/1.1 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTEXNtvQ844a-KGn93sePXbfSNoCBZ117LcTpj5lQT3li6RY0StyMWy3_18CxSBFcMnX6mLWcWi794RlJu3YsRd4vKIcGebK15uwHpNvGWQdZQ-OGc7teGojbBNL5PEsh0yZ8kKumgP74UofXMqpsx4wEpXfvnok91Nul7vwqNSnJG8 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:42:02.262866 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_817ab3905c8541dc9c2bab51764984d0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: b6a3df8d796e4ae6ac358f103903d427 Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.264674 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '7fc41e68-4172-413f-bb4f-08e5b1bc1b70'} Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:42:02.265644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.267659 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.269153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Returning 404 to user: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:42:02.269153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-48cfcfba-b571-4760-992d-d7e31635e893 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 404 len: 111 microversion: 2.20 time: 0.034098 Aug 29 21:42:02.269153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 516/1004] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 21:42:02 2022] DELETE /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:42:02.274907 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:02.276199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 7fc41e68-4172-413f-bb4f-08e5b1bc1b70] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:02.283963 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:02.284702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:02.284843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:02.285645 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:02.286264 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:02.287040 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:02.301329 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] HTTP exception thrown: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Request method failure captured: Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 HTTP/1.1 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTEXNtvQ844a-KGn93sePXbfSNoCBZ117LcTpj5lQT3li6RY0StyMWy3_18CxSBFcMnX6mLWcWi794RlJu3YsRd4vKIcGebK15uwHpNvGWQdZQ-OGc7teGojbBNL5PEsh0yZ8kKumgP74UofXMqpsx4wEpXfvnok91Nul7vwqNSnJG8 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:42:02.303733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_817ab3905c8541dc9c2bab51764984d0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: b6a3df8d796e4ae6ac358f103903d427 Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.305199 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '7fc41e68-4172-413f-bb4f-08e5b1bc1b70'} Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:42:02.306029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. Aug 29 21:42:02.307543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:02.308812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Returning 404 to user: Instance 7fc41e68-4172-413f-bb4f-08e5b1bc1b70 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:42:02.308812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-60db3feb-55e5-4367-8edc-c5b116920c4b tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70" status: 404 len: 111 microversion: 2.20 time: 0.037299 Aug 29 21:42:02.308812 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 489/1005] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:42:02 2022] GET /compute/v2.1/servers/7fc41e68-4172-413f-bb4f-08e5b1bc1b70 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:42:03.477556 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:03.478344 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:03.486064 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:03.486684 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:03.487340 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:03.488288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:03.488929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:03.489559 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:03.505085 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] HTTP exception thrown: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Request method failure captured: Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 HTTP/1.1 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTEXNtvQ844a-KGn93sePXbfSNoCBZ117LcTpj5lQT3li6RY0StyMWy3_18CxSBFcMnX6mLWcWi794RlJu3YsRd4vKIcGebK15uwHpNvGWQdZQ-OGc7teGojbBNL5PEsh0yZ8kKumgP74UofXMqpsx4wEpXfvnok91Nul7vwqNSnJG8 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:42:03.506757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_817ab3905c8541dc9c2bab51764984d0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: b6a3df8d796e4ae6ac358f103903d427 Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.508487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '28d60cc0-bd66-4d79-a1fc-c673f14f3719'} Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:42:03.509490 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.511022 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.513366 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Returning 404 to user: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:42:03.514466 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c1311133-467f-47ab-b037-3343f63fb1ce tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "DELETE /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 404 len: 111 microversion: 2.20 time: 0.040879 Aug 29 21:42:03.515488 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 517/1006] 10.222.0.90 () {60 vars in 1280 bytes} [Mon Aug 29 21:42:03 2022] DELETE /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:42:03.525966 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:03.526770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] [instance: 28d60cc0-bd66-4d79-a1fc-c673f14f3719] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:03.547218 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:03.547732 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:03.548266 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:03.548910 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:03.549574 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:03.550037 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:03.557953 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:03.569696 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] HTTP exception thrown: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Request method failure captured: Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 HTTP/1.1 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTEXNtvQ844a-KGn93sePXbfSNoCBZ117LcTpj5lQT3li6RY0StyMWy3_18CxSBFcMnX6mLWcWi794RlJu3YsRd4vKIcGebK15uwHpNvGWQdZQ-OGc7teGojbBNL5PEsh0yZ8kKumgP74UofXMqpsx4wEpXfvnok91Nul7vwqNSnJG8 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:42:03.571581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/817ab3905c8541dc9c2bab51764984d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_817ab3905c8541dc9c2bab51764984d0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 817ab3905c8541dc9c2bab51764984d0 Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-899890955 Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: b6a3df8d796e4ae6ac358f103903d427 Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-899890955-project Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.573416 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '28d60cc0-bd66-4d79-a1fc-c673f14f3719'} Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:42:03.574382 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. Aug 29 21:42:03.575908 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:42:03.579499 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] Returning 404 to user: Instance 28d60cc0-bd66-4d79-a1fc-c673f14f3719 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:42:03.580739 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-cba71295-ce63-4047-88f6-55a144b09660 tempest-AttachVolumeShelveTestJSON-899890955 tempest-AttachVolumeShelveTestJSON-899890955-project] 10.222.0.90 "GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719" status: 404 len: 111 microversion: 2.20 time: 0.061110 Aug 29 21:42:03.581815 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 490/1007] 10.222.0.90 () {60 vars in 1277 bytes} [Mon Aug 29 21:42:03 2022] GET /compute/v2.1/servers/28d60cc0-bd66-4d79-a1fc-c673f14f3719 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:42:09.538642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:09.539269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:09.542841 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-9cd46a90-3a0a-46d1-a7b1-ea555ab0809d req-a2cb11b2-e6a3-482e-858d-4c91174e6f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3819524d-f3cb-4a48-b655-369801192ff1", "tag": "f25a764e-ad4b-498c-a467-cdffc6e6822b"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:09.551929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:09.552342 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:09.552783 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:09.556018 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:09.556536 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:09.556990 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:09.558486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-9cd46a90-3a0a-46d1-a7b1-ea555ab0809d req-a2cb11b2-e6a3-482e-858d-4c91174e6f94 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:09.559125 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-9cd46a90-3a0a-46d1-a7b1-ea555ab0809d req-a2cb11b2-e6a3-482e-858d-4c91174e6f94 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:09.559664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-9cd46a90-3a0a-46d1-a7b1-ea555ab0809d req-a2cb11b2-e6a3-482e-858d-4c91174e6f94 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:09.594939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:42:09.599707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-9cd46a90-3a0a-46d1-a7b1-ea555ab0809d req-a2cb11b2-e6a3-482e-858d-4c91174e6f94 service nova] Creating event network-changed:f25a764e-ad4b-498c-a467-cdffc6e6822b for instance 3819524d-f3cb-4a48-b655-369801192ff1 on hv-cinder-85426 Aug 29 21:42:09.616107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-9cd46a90-3a0a-46d1-a7b1-ea555ab0809d req-a2cb11b2-e6a3-482e-858d-4c91174e6f94 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076760 Aug 29 21:42:09.621224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 491/1008] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:09.773892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4f739b21-57f6-46cb-8f08-16d27dd3e49d tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 204 len: 0 microversion: 2.1 time: 0.239542 Aug 29 21:42:09.779687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 518/1009] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:42:09 2022] DELETE /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:42:09.787074 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:09.787851 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:09.801470 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:09.802468 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:09.803327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:09.805861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:09.808128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:09.810421 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:10.053852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:10.062117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-dd83a3a3-ae1d-4147-a908-86abc865fd71 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.281138 Aug 29 21:42:10.063504 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 492/1010] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:09 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:11.087228 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:11.088071 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:11.110792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:11.118818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:11.118818 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:11.123971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:11.123971 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:11.126409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:11.453438 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:11.465386 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6ebe24bf-c350-4cee-888d-140afa4dabe4 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1568 microversion: 2.1 time: 0.382932 Aug 29 21:42:11.465990 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 519/1011] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:11 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1568 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:12.492403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:12.493727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:12.501056 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.501982 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.502688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.503747 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.504500 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.505222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.652336 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:12.663636 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0f3b6c5e-2371-4b6f-9078-540111621359 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1382 microversion: 2.1 time: 0.174859 Aug 29 21:42:12.664857 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 493/1012] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:12 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1382 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:12.682447 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-dac7f6e4-6e88-4012-8f15-f99a453c4cd8 req-27da1307-4ea1-4373-ad6b-8310827fb003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3819524d-f3cb-4a48-b655-369801192ff1", "name": "network-vif-deleted", "tag": "f25a764e-ad4b-498c-a467-cdffc6e6822b"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:12.722696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-dac7f6e4-6e88-4012-8f15-f99a453c4cd8 req-27da1307-4ea1-4373-ad6b-8310827fb003 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:12.724901 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-dac7f6e4-6e88-4012-8f15-f99a453c4cd8 req-27da1307-4ea1-4373-ad6b-8310827fb003 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:12.726461 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-dac7f6e4-6e88-4012-8f15-f99a453c4cd8 req-27da1307-4ea1-4373-ad6b-8310827fb003 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:12.750772 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-dac7f6e4-6e88-4012-8f15-f99a453c4cd8 req-27da1307-4ea1-4373-ad6b-8310827fb003 service nova] Creating event network-vif-deleted:f25a764e-ad4b-498c-a467-cdffc6e6822b for instance 3819524d-f3cb-4a48-b655-369801192ff1 on hv-cinder-85426 Aug 29 21:42:12.760721 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-dac7f6e4-6e88-4012-8f15-f99a453c4cd8 req-27da1307-4ea1-4373-ad6b-8310827fb003 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086707 Aug 29 21:42:12.761617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 520/1013] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:13.698061 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:13.700733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:13.715057 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.716383 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.717399 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.720007 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.721082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.722164 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.808249 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:13.808816 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:13.809375 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:13.813006 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.objects.instance [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lazy-loading 'fault' on Instance uuid 3819524d-f3cb-4a48-b655-369801192ff1 {{(pid=127068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:42:13.878327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3376818708e443928951fd5f517c9d83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d7f124802b450eae69db4d42b62d83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:42:13.890989 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-41933a1a-ccc8-419c-ab46-9b1532456b16 tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 200 len: 1225 microversion: 2.1 time: 0.203577 Aug 29 21:42:13.900582 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 494/1014] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:13 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 1225 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:14.917077 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:14.919045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] [instance: 3819524d-f3cb-4a48-b655-369801192ff1] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:42:14.929409 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:14.930300 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:14.931005 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:14.932172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:42:14.933002 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:42:14.933683 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:42:14.953761 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] HTTP exception thrown: Instance 3819524d-f3cb-4a48-b655-369801192ff1 could not be found. Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Request method failure captured: Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 HTTP/1.1 Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTFV65i4RNQpR05hGDfwpcyrU52u_x6RheEp6TlHfira1R9Z-WPH1ANbA0aft4pI2qsTJHAeTjx5plcTqRFtIVF9ick7obZPNLtiA5hbseQMau6KKfGTC0spmX2dHZD9H6iaoxEAAezJIWakPicMKgFuoCkHhtwWnCmeTJb8r8nlvP0 Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 69d7f124802b450eae69db4d42b62d83 Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-TestShelveInstance-400721955 Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:42:14.956929 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/69d7f124802b450eae69db4d42b62d83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/69d7f124802b450eae69db4d42b62d83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/69d7f124802b450eae69db4d42b62d83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_69d7f124802b450eae69db4d42b62d83", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-TestShelveInstance-400721955 Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 69d7f124802b450eae69db4d42b62d83 Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-TestShelveInstance-400721955 Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-TestShelveInstance-400721955-project Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 3376818708e443928951fd5f517c9d83 Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-TestShelveInstance-400721955-project Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 3819524d-f3cb-4a48-b655-369801192ff1 could not be found. Aug 29 21:42:14.958830 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '3819524d-f3cb-4a48-b655-369801192ff1'} Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3819524d-f3cb-4a48-b655-369801192ff1 could not be found. Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:42:14.959906 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3819524d-f3cb-4a48-b655-369801192ff1 could not be found. Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3819524d-f3cb-4a48-b655-369801192ff1 could not be found. Aug 29 21:42:14.961595 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:42:14.964180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Returning 404 to user: Instance 3819524d-f3cb-4a48-b655-369801192ff1 could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:42:14.965561 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-4d65b67f-4b34-4a6d-b291-5b77f781cfeb tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1" status: 404 len: 111 microversion: 2.1 time: 0.053476 Aug 29 21:42:14.971374 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 521/1015] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:42:14 2022] GET /compute/v2.1/servers/3819524d-f3cb-4a48-b655-369801192ff1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:42:15.186398 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e6a5fdc7-fecf-4590-86c4-2e83d04b5c4b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] Calling method '.version_select at 0x7f8bdf59f5e0>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:15.212422 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:15.239351 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e6a5fdc7-fecf-4590-86c4-2e83d04b5c4b tempest-TestShelveInstance-400721955 tempest-TestShelveInstance-400721955-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1756897221" status: 202 len: 0 microversion: 2.1 time: 0.056742 Aug 29 21:42:15.240598 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 495/1016] 10.222.0.90 () {58 vars in 1254 bytes} [Mon Aug 29 21:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1756897221 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:42:42.214067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:42.215030 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:42.458008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7b1eafc6-4f25-4200-98bb-9fbd7edebd91 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Action: 'create', calling method: .version_select at 0x7f8bdfa65280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1583816455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/cixDEfUdXVpWX1WBRJOdy2vEU5BAcsfs+x1MYOVWRCHgohFaFJag00zxQyqrV7Da3TPtlNFGUYdtNZeVpMBMOyb+/9U3XxHe9jJ8ER5u5Of8UVqBUpuC2D/07RkctrQ=="}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:42.476180 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-7b1eafc6-4f25-4200-98bb-9fbd7edebd91 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for project 1ba68826bbc24418aabf0c66294578ca. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:42:42.480172 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-7b1eafc6-4f25-4200-98bb-9fbd7edebd91 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for user 7dceb7dc857348fda46f501288144bde and project 1ba68826bbc24418aabf0c66294578ca. Resources: {'key_pairs'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:42:42.507455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7b1eafc6-4f25-4200-98bb-9fbd7edebd91 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.311934 Aug 29 21:42:42.513611 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 522/1017] 10.222.0.90 () {60 vars in 1159 bytes} [Mon Aug 29 21:42:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:07.851853 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=23 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:07.853054 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 21:43:07.857727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1580555578", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1583816455", "security_groups": [{"name": "tempest-secgroup-smoke-1827931800"}], "block_device_mapping_v2": [{"uuid": "1bfaf20c-08bf-472f-83d4-3f7d96317f32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b60c41ea-0216-483d-9753-f78065bcd6d7"}]}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:07.976161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] validate_networks() for [('b60c41ea-0216-483d-9753-f78065bcd6d7', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:43:08.354262 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:43:08.354689 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:43:08.355185 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:43:08.355596 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:43:08.356012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:43:08.365140 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:08.365622 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:08.366095 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:08.366828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:08.367309 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:08.367737 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:08.385272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for project 1ba68826bbc24418aabf0c66294578ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:43:08.389202 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for user 7dceb7dc857348fda46f501288144bde and project 1ba68826bbc24418aabf0c66294578ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:43:08.445964 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:43:08.448106 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bfaf20c-08bf-472f-83d4-3f7d96317f32',volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:43:08.580640 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f4b30153-dff2-4361-8bb5-52fbdef86c59 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730396 Aug 29 21:43:08.581284 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 496/1018] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:43:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:43:08.589558 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=4 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:08.590726 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:08.595654 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-eaead866-6e10-4a2d-832e-ba65d08c7a89 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:08.597374 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-eaead866-6e10-4a2d-832e-ba65d08c7a89 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:08.655747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-eaead866-6e10-4a2d-832e-ba65d08c7a89 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:08.663710 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-eaead866-6e10-4a2d-832e-ba65d08c7a89 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1095 microversion: 2.1 time: 0.075450 Aug 29 21:43:08.664262 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 523/1019] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:08 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:09.684960 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:09.685674 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:09.692375 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:09.692861 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:09.693304 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:09.694029 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:09.694492 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:09.694922 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:09.756552 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:09.764514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e56a0914-1376-4ea2-b929-08c613633721 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1145 microversion: 2.1 time: 0.083940 Aug 29 21:43:09.765069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 497/1020] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:09 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:10.788992 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:10.789758 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:10.800666 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:10.801542 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:10.802774 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:10.805053 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:10.805583 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:10.806044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:10.913483 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:10.924735 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-e096c0e5-8c93-4677-9d5b-3195aa5589ff tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1211 microversion: 2.1 time: 0.140884 Aug 29 21:43:10.952861 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 524/1021] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:10 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1211 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:11.953316 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:11.954012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:11.962332 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:11.962987 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:11.963529 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:11.964344 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:11.964903 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:11.965436 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:12.216205 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:12.225595 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-271c2abe-60a8-4c17-9a4c-3bda621352d9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.280612 Aug 29 21:43:12.226205 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 498/1022] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:11 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:12.264783 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-9d95b6e5-f4bf-4a0a-87d9-1e6841fa0b0f req-c145646a-cdef-4c77-b224-07988836b67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98043fca-c531-4248-aee5-f52905cd742e", "tag": "06cb6f3c-867d-4b2d-b492-a2c616dd1cc0"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:12.277838 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9d95b6e5-f4bf-4a0a-87d9-1e6841fa0b0f req-c145646a-cdef-4c77-b224-07988836b67f service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:12.278317 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9d95b6e5-f4bf-4a0a-87d9-1e6841fa0b0f req-c145646a-cdef-4c77-b224-07988836b67f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:12.278740 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-9d95b6e5-f4bf-4a0a-87d9-1e6841fa0b0f req-c145646a-cdef-4c77-b224-07988836b67f service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:12.290831 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-9d95b6e5-f4bf-4a0a-87d9-1e6841fa0b0f req-c145646a-cdef-4c77-b224-07988836b67f service nova] Creating event network-changed:06cb6f3c-867d-4b2d-b492-a2c616dd1cc0 for instance 98043fca-c531-4248-aee5-f52905cd742e on hv-cinder-85426 Aug 29 21:43:12.295766 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-9d95b6e5-f4bf-4a0a-87d9-1e6841fa0b0f req-c145646a-cdef-4c77-b224-07988836b67f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034647 Aug 29 21:43:12.296704 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 525/1023] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:13.248427 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:13.248977 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:13.256051 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:13.256551 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:13.256996 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:13.257716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:13.258204 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:13.258636 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:13.492696 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:13.501367 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f79f94f7-c2a1-4004-843e-1ab6dd9c1818 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.256836 Aug 29 21:43:13.501887 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 499/1024] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:13 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:14.525992 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:14.526699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:14.533479 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:14.534008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:14.534471 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:14.535168 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:14.535619 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:14.536114 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:14.674696 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:14.683947 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-af42d5a3-1cf0-4bed-b80c-d51da0ef06fe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.162874 Aug 29 21:43:14.684579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 526/1025] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:14 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:15.704751 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:15.705378 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:15.712097 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:15.712715 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:15.713080 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:15.713811 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:15.714272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:15.714702 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:15.861814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:15.869879 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d56a63ad-cfb7-497d-9b73-b29bc58b0254 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.168939 Aug 29 21:43:15.870454 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 500/1026] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:15 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:16.891741 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:16.892662 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:16.899320 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:16.899805 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:16.900244 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:16.900939 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:16.901394 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:16.901849 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:17.031795 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:17.039482 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-eecb559c-5b2d-418b-8eba-f8a4a876cf4c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.152344 Aug 29 21:43:17.040043 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 527/1027] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:16 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:18.060486 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:18.061105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:18.068479 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:18.068966 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:18.069403 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:18.070307 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:18.070756 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:18.071181 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:18.202513 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:18.210772 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-1235ff97-84a6-482e-8097-54b8dae359f6 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.154208 Aug 29 21:43:18.211330 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 501/1028] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:18 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:19.231679 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:19.232220 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:19.235225 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:19.240751 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:19.241233 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:19.241669 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:19.242395 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:19.242847 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:19.243269 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:19.381025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:19.388747 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-66809af0-ecf4-45e9-8408-0052757a7a43 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.161112 Aug 29 21:43:19.389306 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 528/1029] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:19 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:20.410688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:20.411261 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:20.413334 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:20.414034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=6 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:20.421457 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:20.422043 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:20.422783 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:20.423555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:20.424045 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:20.424482 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:20.567825 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:20.577901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e127e985-c74d-4cf5-9496-35ab2a847a7c tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.171026 Aug 29 21:43:20.579636 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 502/1030] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:20 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:21.491523 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-59411400-92df-4200-834a-de92301792a2 req-5c35793d-e349-4381-a168-bd55c3b08382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98043fca-c531-4248-aee5-f52905cd742e", "name": "network-vif-plugged", "status": "completed", "tag": "06cb6f3c-867d-4b2d-b492-a2c616dd1cc0"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:21.502050 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-59411400-92df-4200-834a-de92301792a2 req-5c35793d-e349-4381-a168-bd55c3b08382 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:21.502599 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-59411400-92df-4200-834a-de92301792a2 req-5c35793d-e349-4381-a168-bd55c3b08382 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:21.503026 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-59411400-92df-4200-834a-de92301792a2 req-5c35793d-e349-4381-a168-bd55c3b08382 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:21.515327 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-59411400-92df-4200-834a-de92301792a2 req-5c35793d-e349-4381-a168-bd55c3b08382 service nova] Creating event network-vif-plugged:06cb6f3c-867d-4b2d-b492-a2c616dd1cc0 for instance 98043fca-c531-4248-aee5-f52905cd742e on hv-cinder-85426 Aug 29 21:43:21.521592 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-59411400-92df-4200-834a-de92301792a2 req-5c35793d-e349-4381-a168-bd55c3b08382 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033671 Aug 29 21:43:21.522282 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 529/1031] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:21.601034 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:21.601654 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:21.609222 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:21.610119 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:21.610298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:21.610875 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:21.611327 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:21.611766 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:21.801290 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:21.809350 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f7225ee8-aafe-4849-84b0-a0474cda18c9 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1267 microversion: 2.1 time: 0.212182 Aug 29 21:43:21.810012 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 503/1032] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:21 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:22.832307 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:22.833013 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:22.839223 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:22.839708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:22.840146 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:22.840832 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:22.841292 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:22.841717 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:22.987548 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:22.995819 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-1568ae54-6642-4896-bd1c-cb78402dde1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1452 microversion: 2.1 time: 0.168466 Aug 29 21:43:22.996385 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 530/1033] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:22 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:23.016374 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:23.017204 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:43:23.023938 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:23.024428 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:23.024868 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:23.025563 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:23.026076 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:23.026514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:23.163408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:43:23.171223 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-e145949b-badd-427b-b6ad-63fc9d7ef4fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1452 microversion: 2.1 time: 0.159226 Aug 29 21:43:23.172444 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 504/1034] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:43:23 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:25.207335 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-fa97fa10-a38e-4f8b-8e92-1925d471a43b req-5163e16a-07df-4f78-b0d0-2277a004c037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98043fca-c531-4248-aee5-f52905cd742e", "tag": "06cb6f3c-867d-4b2d-b492-a2c616dd1cc0"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:25.217147 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-fa97fa10-a38e-4f8b-8e92-1925d471a43b req-5163e16a-07df-4f78-b0d0-2277a004c037 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:43:25.217624 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-fa97fa10-a38e-4f8b-8e92-1925d471a43b req-5163e16a-07df-4f78-b0d0-2277a004c037 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:43:25.218078 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-fa97fa10-a38e-4f8b-8e92-1925d471a43b req-5163e16a-07df-4f78-b0d0-2277a004c037 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:43:25.229855 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-fa97fa10-a38e-4f8b-8e92-1925d471a43b req-5163e16a-07df-4f78-b0d0-2277a004c037 service nova] Creating event network-changed:06cb6f3c-867d-4b2d-b492-a2c616dd1cc0 for instance 98043fca-c531-4248-aee5-f52905cd742e on hv-cinder-85426 Aug 29 21:43:25.235532 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-fa97fa10-a38e-4f8b-8e92-1925d471a43b req-5163e16a-07df-4f78-b0d0-2277a004c037 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032539 Aug 29 21:43:25.236256 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 531/1035] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:17.614829 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:17.615620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=50 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:17.616532 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:45:17.616722 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Mon Aug 29 21:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e (ip 10.222.0.90) !!! Aug 29 21:45:17.618214 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:45:17.618362 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Mon Aug 29 21:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e (ip 10.222.0.90) !!! Aug 29 21:45:17.619975 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 29 21:45:17.620133 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Mon Aug 29 21:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e (ip 10.222.0.90) !!! Aug 29 21:45:17.625161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:17.625700 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:17.642849 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:17.643338 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:17.644337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:17.645239 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:17.645703 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:17.646157 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:17.673358 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Going to try to terminate instance {{(pid=127068) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:45:17.752000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-2d2461ae-e4af-4702-8120-cb9d4459998f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "DELETE /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 204 len: 0 microversion: 2.1 time: 0.138745 Aug 29 21:45:17.752993 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 505/1036] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:45:17 2022] DELETE /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:45:17.761169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=20 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:17.762042 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=36 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:17.763840 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:45:17.763986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Mon Aug 29 21:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e (ip 10.222.0.90) !!! Aug 29 21:45:17.770655 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:17.771391 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:17.779503 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:17.779983 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:17.780417 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:17.781105 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:17.781745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:17.782203 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:18.032025 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:18.040910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-49bfe81f-9237-4bce-a4b4-88525f82e4ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1577 microversion: 2.1 time: 0.282954 Aug 29 21:45:18.041698 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 532/1037] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:17 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1577 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:45:19.063442 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:19.064138 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:19.071087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:19.071570 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:19.072001 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:19.072687 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:19.073136 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:19.073557 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:19.261611 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:19.270175 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-140fbcd7-b7db-4abb-8e25-2cedf5666d16 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1577 microversion: 2.1 time: 0.210990 Aug 29 21:45:19.270746 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 506/1038] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:19 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:20.292224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:20.293680 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:20.304386 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:20.304901 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:20.305649 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:20.306086 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:20.306544 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:20.307824 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:20.379038 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-12c6d177-fa37-438b-ac1d-437682570a2e req-d7efcfae-fad4-4582-bfd0-8f45b8cc14c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98043fca-c531-4248-aee5-f52905cd742e", "name": "network-vif-deleted", "tag": "06cb6f3c-867d-4b2d-b492-a2c616dd1cc0"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:20.383476 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:20.391525 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-12c6d177-fa37-438b-ac1d-437682570a2e req-d7efcfae-fad4-4582-bfd0-8f45b8cc14c2 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:20.392266 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-12c6d177-fa37-438b-ac1d-437682570a2e req-d7efcfae-fad4-4582-bfd0-8f45b8cc14c2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:20.392434 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-9a1d231f-d189-48b5-8117-d35f64ddefad tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 200 len: 1226 microversion: 2.1 time: 0.103728 Aug 29 21:45:20.404678 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 507/1039] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:20 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:20.405819 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-12c6d177-fa37-438b-ac1d-437682570a2e req-d7efcfae-fad4-4582-bfd0-8f45b8cc14c2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:20.424360 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-12c6d177-fa37-438b-ac1d-437682570a2e req-d7efcfae-fad4-4582-bfd0-8f45b8cc14c2 service nova] Creating event network-vif-deleted:06cb6f3c-867d-4b2d-b492-a2c616dd1cc0 for instance 98043fca-c531-4248-aee5-f52905cd742e on hv-cinder-85426 Aug 29 21:45:20.430478 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-12c6d177-fa37-438b-ac1d-437682570a2e req-d7efcfae-fad4-4582-bfd0-8f45b8cc14c2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177407 Aug 29 21:45:20.431445 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 533/1040] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:45:21.412897 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:21.413503 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:21.420899 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:21.421320 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:21.421766 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:21.422494 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:21.423134 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:21.423390 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:21.438414 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] HTTP exception thrown: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Request method failure captured: Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e HTTP/1.1 Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTLMj6_1BqnB-U1NR4qNyXEWGKYTF3ithQCBpGKVMsSOxSrCWPoLn_0thc3iCiLqRpqhpsW9elDSGBpMEXWo8Xf3t-efj8ErnOmGL81z8XAdMByDMnprLYQQAAXhh4fqfgLlTHTinH7UjwHXQ8uKNc7cWP_0X74ygrO3884_ioHy9aQ Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:45:21.440114 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1ba68826bbc24418aabf0c66294578ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 7dceb7dc857348fda46f501288144bde Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:45:21.443047 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '98043fca-c531-4248-aee5-f52905cd742e'} Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:45:21.444629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:45:21.447462 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:45:21.449018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Returning 404 to user: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:45:21.449018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-00f8596c-afc7-40ef-abc9-13a8680d22d2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 404 len: 111 microversion: 2.1 time: 0.034251 Aug 29 21:45:21.449018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 508/1041] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:21 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:45:21.567697 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2076386396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1583816455", "security_groups": [{"name": "tempest-secgroup-smoke-1827931800"}], "block_device_mapping_v2": [{"uuid": "1bfaf20c-08bf-472f-83d4-3f7d96317f32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b60c41ea-0216-483d-9753-f78065bcd6d7"}]}} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:21.685232 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.network.neutron [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] validate_networks() for [('b60c41ea-0216-483d-9753-f78065bcd6d7', None, None, None, None, None)] {{(pid=127069) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:45:22.133636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Flavor limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:45:22.134099 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Image limits 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:45:22.134576 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Flavor pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:45:22.134982 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Image pref 0:0:0 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:45:22.135387 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.virt.hardware [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:45:22.146287 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:22.146853 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:22.147303 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:22.148060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:22.148518 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:22.148970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:22.166503 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for project 1ba68826bbc24418aabf0c66294578ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:45:22.170509 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.quota [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for user 7dceb7dc857348fda46f501288144bde and project 1ba68826bbc24418aabf0c66294578ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:45:22.231856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Going to run 1 instances... {{(pid=127069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:45:22.234133 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bfaf20c-08bf-472f-83d4-3f7d96317f32',volume_size=None,volume_type=None)] {{(pid=127069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:45:22.384508 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c375db50-b8d3-4cd4-bf1b-a487fa8f1f36 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822363 Aug 29 21:45:22.387492 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 534/1042] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:45:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:45:22.401591 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b8c1fccd-fd7e-4609-b1e5-d07e7f17b134 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:22.402253 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b8c1fccd-fd7e-4609-b1e5-d07e7f17b134 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:22.465691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b8c1fccd-fd7e-4609-b1e5-d07e7f17b134 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:22.473985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b8c1fccd-fd7e-4609-b1e5-d07e7f17b134 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1095 microversion: 2.1 time: 0.076285 Aug 29 21:45:22.474925 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 509/1043] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:22 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:23.502234 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:23.502948 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:23.509706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:23.510452 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:23.510936 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:23.511706 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:23.512250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:23.512638 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:23.595143 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:23.605348 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7c414c84-f0ea-4ac1-b302-e24fcbbf7e3f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1201 microversion: 2.1 time: 0.108524 Aug 29 21:45:23.606124 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 535/1044] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:23 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:24.629036 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:24.630328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:24.637701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:24.638224 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:24.638673 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:24.639395 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:24.639852 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:24.640483 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:24.895163 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:24.908438 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-eb8c1822-ebb8-43b3-b7ad-5cb689bb8e1d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.283830 Aug 29 21:45:24.909598 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 510/1045] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:24 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:25.402441 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-50eff5c2-b024-47db-a931-8a524312e52c req-c14d2d14-2d49-4a7a-9c2b-e52716b549da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9fed58-8463-4c45-9786-0dd3f62b5e73", "tag": "3ffe2a2e-75d1-4c4c-9882-32b6eee736cb"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:25.413135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-50eff5c2-b024-47db-a931-8a524312e52c req-c14d2d14-2d49-4a7a-9c2b-e52716b549da service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:25.413606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-50eff5c2-b024-47db-a931-8a524312e52c req-c14d2d14-2d49-4a7a-9c2b-e52716b549da service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:25.414067 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-50eff5c2-b024-47db-a931-8a524312e52c req-c14d2d14-2d49-4a7a-9c2b-e52716b549da service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:25.426539 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-50eff5c2-b024-47db-a931-8a524312e52c req-c14d2d14-2d49-4a7a-9c2b-e52716b549da service nova] Creating event network-changed:3ffe2a2e-75d1-4c4c-9882-32b6eee736cb for instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 on hv-cinder-85426 Aug 29 21:45:25.431581 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-50eff5c2-b024-47db-a931-8a524312e52c req-c14d2d14-2d49-4a7a-9c2b-e52716b549da service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033139 Aug 29 21:45:25.432414 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 536/1046] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:45:25.935763 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:25.936406 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:25.943698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:25.944181 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:25.944618 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:25.945298 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:25.945748 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:25.946192 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:26.167569 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:26.176896 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-354165af-e488-4bc3-aa49-585dbe489f1a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.244273 Aug 29 21:45:26.177626 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 511/1047] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:25 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:27.198263 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:27.198993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:27.205443 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:27.205970 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:27.207130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:27.207831 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:27.208290 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:27.208718 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:27.345856 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:27.354499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-86695f69-c41b-4d7c-8a17-8d99e4b1853d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.160839 Aug 29 21:45:27.355083 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 537/1048] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:27 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:45:28.376226 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:28.376829 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:28.384033 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:28.384514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:28.384952 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:28.385632 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:28.386190 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:28.386616 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:28.523040 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:28.530782 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f6a900fe-fbf9-4a2c-982b-21eb67a0816d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.158477 Aug 29 21:45:28.531352 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 512/1049] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:28 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:29.552473 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:29.553094 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:29.560142 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:29.560633 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:29.561100 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:29.561806 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:29.562272 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:29.562699 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:29.696921 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:29.704922 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-dde6e956-5b73-4644-8be6-83085145ba7d tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.156683 Aug 29 21:45:29.705482 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 538/1050] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:29 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:45:30.726764 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:30.727405 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:30.733763 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:30.734272 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:30.734708 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:30.735387 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:30.735839 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:30.736262 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:30.870264 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:30.878332 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8971ef69-8cd4-4a99-bddf-67a5438557e0 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.155333 Aug 29 21:45:30.878991 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 513/1051] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:30 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:31.899076 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:31.899685 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:31.906135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.906617 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.907057 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:31.907750 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:31.908207 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:31.908641 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:32.048525 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:32.057311 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6dfb952a-a58d-49ec-bc4e-2f560465c66b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.162040 Aug 29 21:45:32.058008 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 539/1052] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:31 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:33.079152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:33.079796 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:33.082985 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:33.088474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:33.088960 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:33.089397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:33.090150 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:33.090606 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:33.091031 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:33.226701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:33.234426 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-f9204e35-ec5b-449e-b6c6-2a5f16b2b7d8 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.159460 Aug 29 21:45:33.235000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 514/1053] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:33 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:34.114671 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:34.115569 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=6 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:34.174060 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-f980bec6-dd9b-40d0-a0f0-d504c3da0975 req-0149b04a-70c3-4d7a-9a3f-048c078ca52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9fed58-8463-4c45-9786-0dd3f62b5e73", "name": "network-vif-plugged", "status": "completed", "tag": "3ffe2a2e-75d1-4c4c-9882-32b6eee736cb"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:34.184155 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-f980bec6-dd9b-40d0-a0f0-d504c3da0975 req-0149b04a-70c3-4d7a-9a3f-048c078ca52d service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:34.184627 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-f980bec6-dd9b-40d0-a0f0-d504c3da0975 req-0149b04a-70c3-4d7a-9a3f-048c078ca52d service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:34.185055 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-f980bec6-dd9b-40d0-a0f0-d504c3da0975 req-0149b04a-70c3-4d7a-9a3f-048c078ca52d service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:34.198153 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-f980bec6-dd9b-40d0-a0f0-d504c3da0975 req-0149b04a-70c3-4d7a-9a3f-048c078ca52d service nova] Creating event network-vif-plugged:3ffe2a2e-75d1-4c4c-9882-32b6eee736cb for instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 on hv-cinder-85426 Aug 29 21:45:34.203323 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-f980bec6-dd9b-40d0-a0f0-d504c3da0975 req-0149b04a-70c3-4d7a-9a3f-048c078ca52d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093565 Aug 29 21:45:34.204134 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 540/1054] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:45:34.255814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:34.256429 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:34.262898 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:34.263380 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:34.263815 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:34.264498 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:34.264949 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:34.265370 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:34.434229 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:34.443579 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a388b7ed-c7c6-4939-bf99-ea39850943af tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1267 microversion: 2.1 time: 0.191746 Aug 29 21:45:34.444175 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 515/1055] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:34 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:35.467017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:35.467718 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:35.474767 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:35.475516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:35.476200 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:35.477285 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:35.477806 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:35.478250 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:35.623892 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:35.632547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-2949442a-7892-45a8-978e-414994d1b23a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1453 microversion: 2.1 time: 0.170460 Aug 29 21:45:35.633339 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 541/1056] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:35 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:35.653287 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:45:35.653937 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:45:35.661040 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:35.661527 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:35.662004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:35.662710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:35.663179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:35.663610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:35.799614 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:45:35.807672 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-b80edceb-0ea6-4832-a167-4985e9f4e053 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1453 microversion: 2.1 time: 0.158194 Aug 29 21:45:35.808223 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 516/1057] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:45:35 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:45:37.411225 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [req-e858c6b6-3aec-4166-b08c-47c47c29ad2d req-913f697f-641d-40dd-9761-37423fcdd1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9fed58-8463-4c45-9786-0dd3f62b5e73", "tag": "3ffe2a2e-75d1-4c4c-9882-32b6eee736cb"}]} {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:45:37.421027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-e858c6b6-3aec-4166-b08c-47c47c29ad2d req-913f697f-641d-40dd-9761-37423fcdd1ea service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:45:37.421499 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-e858c6b6-3aec-4166-b08c-47c47c29ad2d req-913f697f-641d-40dd-9761-37423fcdd1ea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:45:37.421956 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [req-e858c6b6-3aec-4166-b08c-47c47c29ad2d req-913f697f-641d-40dd-9761-37423fcdd1ea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:45:37.433083 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.compute.server_external_events [req-e858c6b6-3aec-4166-b08c-47c47c29ad2d req-913f697f-641d-40dd-9761-37423fcdd1ea service nova] Creating event network-changed:3ffe2a2e-75d1-4c4c-9882-32b6eee736cb for instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 on hv-cinder-85426 Aug 29 21:45:37.438143 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [req-e858c6b6-3aec-4166-b08c-47c47c29ad2d req-913f697f-641d-40dd-9761-37423fcdd1ea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031214 Aug 29 21:45:37.438979 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 542/1058] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:47:11.754355 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:11.755109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:11.760007 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-742393931", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1583816455", "security_groups": [{"name": "tempest-secgroup-smoke-1827931800"}], "block_device_mapping_v2": [{"uuid": "bab40abb-ce2e-4f00-89fc-844132401701", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b60c41ea-0216-483d-9753-f78065bcd6d7"}]}} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:47:11.879104 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.network.neutron [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] validate_networks() for [('b60c41ea-0216-483d-9753-f78065bcd6d7', None, None, None, None, None)] {{(pid=127068) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:47:12.329117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Flavor limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:47:12.329535 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Image limits 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:47:12.330610 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Flavor pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:47:12.331131 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Image pref 0:0:0 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:47:12.331554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.virt.hardware [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:47:12.340432 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:12.340910 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:12.341337 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:12.342167 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:12.342617 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:12.343041 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:12.362581 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for project 1ba68826bbc24418aabf0c66294578ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:47:12.366474 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.quota [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Getting quotas for user 7dceb7dc857348fda46f501288144bde and project 1ba68826bbc24418aabf0c66294578ca. Resources: {'cores', 'instances', 'ram'} {{(pid=127068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:47:12.425000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Going to run 1 instances... {{(pid=127068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:47:12.427254 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bab40abb-ce2e-4f00-89fc-844132401701',volume_size=None,volume_type=None)] {{(pid=127068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:47:12.561105 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-0daabce7-a7fe-4170-b19b-4fca422c26ee tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809199 Aug 29 21:47:12.561814 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 517/1059] 10.222.0.90 () {60 vars in 1147 bytes} [Mon Aug 29 21:47:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:47:12.572028 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:12.572895 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=46 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:12.573646 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:47:12.574030 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Mon Aug 29 21:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d (ip 10.222.0.90) !!! Aug 29 21:47:12.579545 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-86a5f48b-3bde-45d6-9ce6-be54e2514a62 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:12.581554 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-86a5f48b-3bde-45d6-9ce6-be54e2514a62 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:12.647752 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-86a5f48b-3bde-45d6-9ce6-be54e2514a62 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:12.654919 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-86a5f48b-3bde-45d6-9ce6-be54e2514a62 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1094 microversion: 2.1 time: 0.084867 Aug 29 21:47:12.655493 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 543/1060] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:12 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:13.676339 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:13.677120 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:13.684396 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:13.685031 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:13.685574 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:13.686392 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:13.686926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:13.687424 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:13.788073 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:13.796020 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-57e3964e-539d-48c8-9b83-d33b072b0572 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1210 microversion: 2.1 time: 0.124771 Aug 29 21:47:13.796688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 518/1061] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:13 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:14.818252 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:14.819073 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:14.827757 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:14.828288 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:14.828726 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:14.829628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:14.830900 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:14.831642 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:15.019968 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-6dc61dd9-1cf5-4213-bbc2-62a51ad01a41 req-e44d390d-cf61-4612-bb33-02801213bbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b524956-03ac-488b-9c3c-6b555d11953d", "tag": "d94e8d7a-dba0-47ff-9007-2be8845e2eea"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:47:15.030220 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-6dc61dd9-1cf5-4213-bbc2-62a51ad01a41 req-e44d390d-cf61-4612-bb33-02801213bbb2 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:15.030733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-6dc61dd9-1cf5-4213-bbc2-62a51ad01a41 req-e44d390d-cf61-4612-bb33-02801213bbb2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:15.031185 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-6dc61dd9-1cf5-4213-bbc2-62a51ad01a41 req-e44d390d-cf61-4612-bb33-02801213bbb2 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:15.043447 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-6dc61dd9-1cf5-4213-bbc2-62a51ad01a41 req-e44d390d-cf61-4612-bb33-02801213bbb2 service nova] Creating event network-changed:d94e8d7a-dba0-47ff-9007-2be8845e2eea for instance 3b524956-03ac-488b-9c3c-6b555d11953d on hv-cinder-85426 Aug 29 21:47:15.048429 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-6dc61dd9-1cf5-4213-bbc2-62a51ad01a41 req-e44d390d-cf61-4612-bb33-02801213bbb2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033588 Aug 29 21:47:15.050202 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 519/1062] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:47:15.103145 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:15.110941 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c90ba580-6c76-4c95-b3da-dab826c3f0fd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.297261 Aug 29 21:47:15.112644 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 544/1063] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:14 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:16.134206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:16.134909 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:16.141310 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:16.141801 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:16.142392 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:16.143109 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:16.143574 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:16.144008 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:16.278078 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:16.286770 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-a5f64d63-907f-4121-87a3-43931e928a2a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.157394 Aug 29 21:47:16.287408 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 520/1064] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:16 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:17.309217 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:17.309937 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:17.317542 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:17.318045 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:17.318487 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:17.319197 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:17.319653 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:17.320082 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:17.455760 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:17.464130 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c75e9937-ad71-4cb3-ab99-ad898b33f188 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.158562 Aug 29 21:47:17.464875 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 545/1065] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:17 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:18.484707 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:18.485318 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:18.492080 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:18.492566 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:18.493000 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:18.493688 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:18.494291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:18.494715 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:18.631675 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:18.639510 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-38231885-90cb-4f7b-9bce-0230285196b2 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.158706 Aug 29 21:47:18.640087 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 521/1066] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:18 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:19.660998 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:19.661585 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:19.668612 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:19.669118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:19.669547 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:19.670254 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:19.670702 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:19.671119 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:19.804027 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:19.811969 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-b0ef8dff-5dab-492e-bbba-f87dbdb97af3 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.154796 Aug 29 21:47:19.812554 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 546/1067] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:19 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:20.833564 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:20.834260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:20.840890 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:20.841376 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:20.841825 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:20.842514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:20.842960 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:20.843376 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:20.981491 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:20.990069 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8db07b45-344d-4439-8c64-eb3670267dc4 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.160411 Aug 29 21:47:20.990638 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 522/1068] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:20 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:22.010514 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:22.011081 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:22.018362 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:22.018851 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:22.019284 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:22.019981 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:22.020432 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:22.020858 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:22.154156 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:22.162170 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7856f7a3-5b1f-49c0-aefa-b39d7bc0afba tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.155559 Aug 29 21:47:22.162729 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 547/1069] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:22 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:23.183450 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:23.184172 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:23.186725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=2 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:23.187620 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell0:SELECT=6 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:23.193887 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:23.194385 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:23.194821 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:23.195519 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:23.195975 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:23.196509 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:23.338397 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:23.347668 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-21262cf4-cf38-485e-9e2b-71fb41dc9c79 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.168034 Aug 29 21:47:23.348261 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 523/1070] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:23 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:24.370051 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:24.370643 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:24.372586 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell0:SELECT=2 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:47:24.379226 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:24.379708 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:24.380169 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:24.380896 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:24.381349 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:24.381773 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:24.513177 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:24.521440 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-7097c232-297d-4cee-a5f4-eaca3cc7020a tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.155215 Aug 29 21:47:24.522050 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 548/1071] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:24 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:24.682101 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-f31b3a1a-efcc-41c1-8c18-1b264e32c7c9 req-d01ef499-81fc-4564-a2b1-c4fbf6d64eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b524956-03ac-488b-9c3c-6b555d11953d", "name": "network-vif-plugged", "status": "completed", "tag": "d94e8d7a-dba0-47ff-9007-2be8845e2eea"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:47:24.693501 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-f31b3a1a-efcc-41c1-8c18-1b264e32c7c9 req-d01ef499-81fc-4564-a2b1-c4fbf6d64eea service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:24.694018 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-f31b3a1a-efcc-41c1-8c18-1b264e32c7c9 req-d01ef499-81fc-4564-a2b1-c4fbf6d64eea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:24.694458 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-f31b3a1a-efcc-41c1-8c18-1b264e32c7c9 req-d01ef499-81fc-4564-a2b1-c4fbf6d64eea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:24.706520 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-f31b3a1a-efcc-41c1-8c18-1b264e32c7c9 req-d01ef499-81fc-4564-a2b1-c4fbf6d64eea service nova] Creating event network-vif-plugged:d94e8d7a-dba0-47ff-9007-2be8845e2eea for instance 3b524956-03ac-488b-9c3c-6b555d11953d on hv-cinder-85426 Aug 29 21:47:24.711698 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-f31b3a1a-efcc-41c1-8c18-1b264e32c7c9 req-d01ef499-81fc-4564-a2b1-c4fbf6d64eea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Aug 29 21:47:24.712381 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 524/1072] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:47:25.543995 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:25.544668 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:25.551676 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:25.552178 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:25.552655 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:25.553415 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:25.553916 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:25.554345 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:25.697902 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:25.705948 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c40c2596-0c11-450e-94a8-9e1657267845 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1266 microversion: 2.1 time: 0.166690 Aug 29 21:47:25.706524 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 549/1073] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:25 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:26.731882 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:26.732575 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:26.740045 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:26.740586 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:26.741046 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:26.741725 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:26.742206 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:26.742627 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:26.905938 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:26.914166 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-ce6b29f9-69d7-45c2-8dc7-808bd275b5da tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1451 microversion: 2.1 time: 0.187711 Aug 29 21:47:26.915099 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 525/1074] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:26 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:26.936594 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:47:26.937628 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:47:26.946066 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:26.946562 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:26.946993 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:26.947681 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:26.948129 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:26.948548 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:27.107281 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:47:27.115626 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-14a0b1d7-0950-48a9-9690-979bdf3f5b60 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1451 microversion: 2.1 time: 0.183466 Aug 29 21:47:27.116195 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 550/1075] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:47:26 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:47:29.063445 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-b10bf5f4-6139-4031-8d9a-954d52fa12a5 req-b60256aa-51bc-4ed4-91d8-85233807d3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b524956-03ac-488b-9c3c-6b555d11953d", "tag": "d94e8d7a-dba0-47ff-9007-2be8845e2eea"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:47:29.073778 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b10bf5f4-6139-4031-8d9a-954d52fa12a5 req-b60256aa-51bc-4ed4-91d8-85233807d3f4 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:47:29.074296 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b10bf5f4-6139-4031-8d9a-954d52fa12a5 req-b60256aa-51bc-4ed4-91d8-85233807d3f4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:47:29.074738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-b10bf5f4-6139-4031-8d9a-954d52fa12a5 req-b60256aa-51bc-4ed4-91d8-85233807d3f4 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:47:29.086629 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-b10bf5f4-6139-4031-8d9a-954d52fa12a5 req-b60256aa-51bc-4ed4-91d8-85233807d3f4 service nova] Creating event network-changed:d94e8d7a-dba0-47ff-9007-2be8845e2eea for instance 3b524956-03ac-488b-9c3c-6b555d11953d on hv-cinder-85426 Aug 29 21:47:29.091775 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-b10bf5f4-6139-4031-8d9a-954d52fa12a5 req-b60256aa-51bc-4ed4-91d8-85233807d3f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032638 Aug 29 21:47:29.092615 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 526/1076] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:48:57.478458 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_api:SELECT=18 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:57.481917 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:57.483020 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG dbcounter [-] [127069] Writing DB stats nova_cell1:SELECT=42 {{(pid=127069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:57.484182 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG dbcounter [-] [127068] Writing DB stats nova_cell1:SELECT=44 {{(pid=127068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:57.486265 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:48:57.486734 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Mon Aug 29 21:48:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d (ip 10.222.0.90) !!! Aug 29 21:48:57.487686 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:48:57.487834 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Mon Aug 29 21:48:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Aug 29 21:48:57.488788 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 21:48:57.488928 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Mon Aug 29 21:48:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d (ip 10.222.0.90) !!! Aug 29 21:48:57.496072 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:57.496562 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:48:57.501926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-96ae9b75-2743-44cb-bc6a-9007accb8b03 req-8ca5e6b9-ba7e-4ad8-b599-924f37b8e11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b524956-03ac-488b-9c3c-6b555d11953d", "tag": "d94e8d7a-dba0-47ff-9007-2be8845e2eea"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:48:57.518782 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-96ae9b75-2743-44cb-bc6a-9007accb8b03 req-8ca5e6b9-ba7e-4ad8-b599-924f37b8e11e service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:57.519260 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-96ae9b75-2743-44cb-bc6a-9007accb8b03 req-8ca5e6b9-ba7e-4ad8-b599-924f37b8e11e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:57.519691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-96ae9b75-2743-44cb-bc6a-9007accb8b03 req-8ca5e6b9-ba7e-4ad8-b599-924f37b8e11e service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:57.519942 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:57.520505 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:57.521015 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:57.521816 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:57.522384 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:57.522913 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:57.532211 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-96ae9b75-2743-44cb-bc6a-9007accb8b03 req-8ca5e6b9-ba7e-4ad8-b599-924f37b8e11e service nova] Creating event network-changed:d94e8d7a-dba0-47ff-9007-2be8845e2eea for instance 3b524956-03ac-488b-9c3c-6b555d11953d on hv-cinder-85426 Aug 29 21:48:57.537473 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-96ae9b75-2743-44cb-bc6a-9007accb8b03 req-8ca5e6b9-ba7e-4ad8-b599-924f37b8e11e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057327 Aug 29 21:48:57.538117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 527/1077] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:48:57.552665 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:48:57.652131 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-c3bc6fce-1c94-4736-9d06-a5bb8462102f tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 204 len: 0 microversion: 2.1 time: 0.174857 Aug 29 21:48:57.656379 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 551/1078] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:48:57 2022] DELETE /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:48:57.663128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:57.663838 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:48:57.670733 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:57.671221 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:57.671664 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:57.674058 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:57.674706 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:57.674939 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:57.833765 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:48:57.841543 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-32d798ae-fbff-4314-8326-9fe766b5c7fb tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1576 microversion: 2.1 time: 0.183311 Aug 29 21:48:57.842349 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 528/1079] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:48:57 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:48:58.864455 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:58.865143 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:48:58.872166 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:58.872637 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:58.873065 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:58.873745 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:58.874223 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:58.874641 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:59.380577 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:48:59.388352 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-83f532ad-21e1-4e82-b22a-b8707bac05cd tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1576 microversion: 2.1 time: 0.528700 Aug 29 21:48:59.389163 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 552/1080] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:48:58 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1576 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:48:59.899500 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-20743ef8-3c21-43ca-9ba9-1221d78dba4c req-2fd83b1b-a497-4bba-b47e-61f3f0a65cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b524956-03ac-488b-9c3c-6b555d11953d", "name": "network-vif-deleted", "tag": "d94e8d7a-dba0-47ff-9007-2be8845e2eea"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:48:59.910752 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-20743ef8-3c21-43ca-9ba9-1221d78dba4c req-2fd83b1b-a497-4bba-b47e-61f3f0a65cea service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:59.911328 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-20743ef8-3c21-43ca-9ba9-1221d78dba4c req-2fd83b1b-a497-4bba-b47e-61f3f0a65cea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:59.911843 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-20743ef8-3c21-43ca-9ba9-1221d78dba4c req-2fd83b1b-a497-4bba-b47e-61f3f0a65cea service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:59.925710 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-20743ef8-3c21-43ca-9ba9-1221d78dba4c req-2fd83b1b-a497-4bba-b47e-61f3f0a65cea service nova] Creating event network-vif-deleted:d94e8d7a-dba0-47ff-9007-2be8845e2eea for instance 3b524956-03ac-488b-9c3c-6b555d11953d on hv-cinder-85426 Aug 29 21:48:59.930862 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-20743ef8-3c21-43ca-9ba9-1221d78dba4c req-2fd83b1b-a497-4bba-b47e-61f3f0a65cea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035090 Aug 29 21:48:59.931466 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 529/1081] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:49:00.409899 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:00.410472 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:00.422587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:00.423004 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:00.423436 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:00.424135 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:00.424579 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:00.424994 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:00.458039 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:00.458516 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:00.458944 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:00.459375 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lazy-loading 'fault' on Instance uuid 3b524956-03ac-488b-9c3c-6b555d11953d {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:49:00.502047 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:49:00.510205 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6beaa457-64fa-4f23-89eb-3b458ce3df50 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 200 len: 1230 microversion: 2.1 time: 0.104321 Aug 29 21:49:00.510770 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 553/1082] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:49:00 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:49:01.534212 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:01.534952 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 3b524956-03ac-488b-9c3c-6b555d11953d] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:01.541174 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:01.541663 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:01.542136 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:01.542828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:01.543289 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:01.543716 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:01.558939 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] HTTP exception thrown: Instance 3b524956-03ac-488b-9c3c-6b555d11953d could not be found. Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Request method failure captured: Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d HTTP/1.1 Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTLMj6_1BqnB-U1NR4qNyXEWGKYTF3ithQCBpGKVMsSOxSrCWPoLn_0thc3iCiLqRpqhpsW9elDSGBpMEXWo8Xf3t-efj8ErnOmGL81z8XAdMByDMnprLYQQAAXhh4fqfgLlTHTinH7UjwHXQ8uKNc7cWP_0X74ygrO3884_ioHy9aQ Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:49:01.560555 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1ba68826bbc24418aabf0c66294578ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 7dceb7dc857348fda46f501288144bde Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 3b524956-03ac-488b-9c3c-6b555d11953d could not be found. Aug 29 21:49:01.562154 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '3b524956-03ac-488b-9c3c-6b555d11953d'} Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b524956-03ac-488b-9c3c-6b555d11953d could not be found. Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:49:01.563117 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b524956-03ac-488b-9c3c-6b555d11953d could not be found. Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b524956-03ac-488b-9c3c-6b555d11953d could not be found. Aug 29 21:49:01.565064 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:01.566926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Returning 404 to user: Instance 3b524956-03ac-488b-9c3c-6b555d11953d could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:49:01.566926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-d302dbc6-d880-4da8-b9df-3087ac50e84b tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d" status: 404 len: 111 microversion: 2.1 time: 0.033470 Aug 29 21:49:01.566926 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 530/1083] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:49:01 2022] GET /compute/v2.1/servers/3b524956-03ac-488b-9c3c-6b555d11953d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:49:04.662351 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-bfac6282-1c02-41cc-ba34-d1cfef1f09e2 req-81e2d9cd-a4a8-4eae-b10a-428c7d8eca12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9fed58-8463-4c45-9786-0dd3f62b5e73", "tag": "3ffe2a2e-75d1-4c4c-9882-32b6eee736cb"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:49:04.666428 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:04.666930 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:04.673116 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:04.673566 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:04.674044 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:04.674738 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:04.675188 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:04.675606 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:04.684225 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-bfac6282-1c02-41cc-ba34-d1cfef1f09e2 req-81e2d9cd-a4a8-4eae-b10a-428c7d8eca12 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:04.684701 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-bfac6282-1c02-41cc-ba34-d1cfef1f09e2 req-81e2d9cd-a4a8-4eae-b10a-428c7d8eca12 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:04.685128 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-bfac6282-1c02-41cc-ba34-d1cfef1f09e2 req-81e2d9cd-a4a8-4eae-b10a-428c7d8eca12 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:04.697161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-bfac6282-1c02-41cc-ba34-d1cfef1f09e2 req-81e2d9cd-a4a8-4eae-b10a-428c7d8eca12 service nova] Creating event network-changed:3ffe2a2e-75d1-4c4c-9882-32b6eee736cb for instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 on hv-cinder-85426 Aug 29 21:49:04.702570 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-bfac6282-1c02-41cc-ba34-d1cfef1f09e2 req-81e2d9cd-a4a8-4eae-b10a-428c7d8eca12 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044044 Aug 29 21:49:04.704665 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 531/1084] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:49:04.713805 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Going to try to terminate instance {{(pid=127069) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:49:04.799338 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-475d22c1-b7a1-4057-91ab-b15e32466bfe tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 204 len: 0 microversion: 2.1 time: 0.144598 Aug 29 21:49:04.801989 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 554/1085] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:49:04 2022] DELETE /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:49:04.811143 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:04.812178 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:04.818727 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:04.819305 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:04.819818 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:04.820617 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:04.821144 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:04.821828 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:04.996292 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.policy [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127068) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:49:05.004946 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-544506ec-eca8-4ba1-bdc3-644fcab87296 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1578 microversion: 2.1 time: 0.198037 Aug 29 21:49:05.005538 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 532/1086] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:49:04 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1578 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:49:06.027510 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:06.028323 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:06.035587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:06.036138 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:06.036498 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:06.037323 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:06.037810 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:06.038355 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:06.234687 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:49:06.242789 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-29fd9b80-d49f-4995-83e0-d120c2ea4124 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1578 microversion: 2.1 time: 0.219439 Aug 29 21:49:06.243536 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 555/1087] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:49:06 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:49:06.853588 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [req-2f476004-5383-4169-9f5e-a792cce246d3 req-50f3c851-0e95-449f-a822-f5cc8639f3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9fed58-8463-4c45-9786-0dd3f62b5e73", "name": "network-vif-deleted", "tag": "3ffe2a2e-75d1-4c4c-9882-32b6eee736cb"}]} {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:49:06.865559 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-2f476004-5383-4169-9f5e-a792cce246d3 req-50f3c851-0e95-449f-a822-f5cc8639f3f3 service nova] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:06.866084 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-2f476004-5383-4169-9f5e-a792cce246d3 req-50f3c851-0e95-449f-a822-f5cc8639f3f3 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:06.866514 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [req-2f476004-5383-4169-9f5e-a792cce246d3 req-50f3c851-0e95-449f-a822-f5cc8639f3f3 service nova] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:06.879179 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.compute.server_external_events [req-2f476004-5383-4169-9f5e-a792cce246d3 req-50f3c851-0e95-449f-a822-f5cc8639f3f3 service nova] Creating event network-vif-deleted:3ffe2a2e-75d1-4c4c-9882-32b6eee736cb for instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 on hv-cinder-85426 Aug 29 21:49:06.884102 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [req-2f476004-5383-4169-9f5e-a792cce246d3 req-50f3c851-0e95-449f-a822-f5cc8639f3f3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034172 Aug 29 21:49:06.884691 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 533/1088] 10.222.0.90 () {64 vars in 1317 bytes} [Mon Aug 29 21:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:49:07.263792 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:07.264397 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:07.271121 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:07.271590 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:07.272017 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:07.272695 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:07.273140 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:07.273560 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:07.304751 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:07.305223 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:07.305657 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:07.306118 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.objects.instance [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lazy-loading 'fault' on Instance uuid 6e9fed58-8463-4c45-9786-0dd3f62b5e73 {{(pid=127069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:49:07.350368 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.policy [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dceb7dc857348fda46f501288144bde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba68826bbc24418aabf0c66294578ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127069) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:49:07.358052 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-bc0795b1-8181-4b8e-b7a0-7bf659331072 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 200 len: 1231 microversion: 2.1 time: 0.098076 Aug 29 21:49:07.358610 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 556/1089] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:49:07 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:49:08.381591 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:08.382339 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 6e9fed58-8463-4c45-9786-0dd3f62b5e73] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:08.388668 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:08.389155 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:08.389600 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:08.390323 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:08.390788 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:08.391869 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:08.405161 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] HTTP exception thrown: Instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 could not be found. Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Request method failure captured: Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 HTTP/1.1 Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTLMj6_1BqnB-U1NR4qNyXEWGKYTF3ithQCBpGKVMsSOxSrCWPoLn_0thc3iCiLqRpqhpsW9elDSGBpMEXWo8Xf3t-efj8ErnOmGL81z8XAdMByDMnprLYQQAAXhh4fqfgLlTHTinH7UjwHXQ8uKNc7cWP_0X74ygrO3884_ioHy9aQ Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:49:08.407497 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1ba68826bbc24418aabf0c66294578ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 7dceb7dc857348fda46f501288144bde Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 could not be found. Aug 29 21:49:08.410082 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '6e9fed58-8463-4c45-9786-0dd3f62b5e73'} Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 could not be found. Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:49:08.411568 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 could not be found. Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 could not be found. Aug 29 21:49:08.414230 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.417294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Returning 404 to user: Instance 6e9fed58-8463-4c45-9786-0dd3f62b5e73 could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:49:08.417294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-8949cd7d-f168-44ee-9c48-46ad9867e8db tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73" status: 404 len: 111 microversion: 2.1 time: 0.032409 Aug 29 21:49:08.417294 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 534/1090] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:49:08 2022] GET /compute/v2.1/servers/6e9fed58-8463-4c45-9786-0dd3f62b5e73 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:49:08.866393 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:08.866876 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.compute.api [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127069) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:08.873117 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:08.873587 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:08.874056 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:08.874734 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:08.875179 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:08.875842 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG oslo_concurrency.lockutils [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:08.889331 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.wsgi [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] HTTP exception thrown: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Request method failure captured: Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: request: DELETE /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e HTTP/1.1 Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept: application/json Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Accept-Encoding: identity Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Connection: close Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Length: 0 Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Content-Type: application/json Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Host: 10.222.0.90 Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: Openstack-System-Scope: None Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: User-Agent: python-urllib3/1.26.12 Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Auth-Token: gAAAAABjDTLMj6_1BqnB-U1NR4qNyXEWGKYTF3ithQCBpGKVMsSOxSrCWPoLn_0thc3iCiLqRpqhpsW9elDSGBpMEXWo8Xf3t-efj8ErnOmGL81z8XAdMByDMnprLYQQAAXhh4fqfgLlTHTinH7UjwHXQ8uKNc7cWP_0X74ygrO3884_ioHy9aQ Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Id: None Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Domain-Name: None Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Identity-Status: Confirmed Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Is-Admin-Project: True Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Id: default Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Domain-Name: Default Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Project-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Role: reader,member Aug 29 21:49:08.891086 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Roles: reader,member Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1ba68826bbc24418aabf0c66294578ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Id: default Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Domain-Name: Default Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Id: 7dceb7dc857348fda46f501288144bde Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: X-User-Name: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: method: > Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: exception: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.892880 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: action_args: {'id': '98043fca-c531-4248-aee5-f52905cd742e'} Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:49:08.893910 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.895636 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.897227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Returning 404 to user: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. {{(pid=127069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:49:08.897227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-6eab3cc3-8c19-476b-88cf-a897ed48a964 tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "DELETE /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 404 len: 111 microversion: 2.1 time: 0.030112 Aug 29 21:49:08.897227 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 557/1091] 10.222.0.90 () {58 vars in 1239 bytes} [Mon Aug 29 21:49:08 2022] DELETE /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:49:08.901107 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '>' {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:08.901741 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.compute.api [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] [instance: 98043fca-c531-4248-aee5-f52905cd742e] Fetching instance by UUID {{(pid=127068) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:49:08.908484 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:08.908974 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:08.909418 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:08.910141 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Acquiring lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:08.910603 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:08.911035 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG oslo_concurrency.lockutils [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Lock "71bef045-c1a3-4f8f-abb1-d21f8e4fc7f2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:08.925152 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.wsgi [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] HTTP exception thrown: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Request method failure captured: Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: request: GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e HTTP/1.1 Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept: application/json Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Accept-Encoding: identity Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Connection: close Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Length: 0 Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Content-Type: application/json Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Host: 10.222.0.90 Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: Openstack-System-Scope: None Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: User-Agent: python-urllib3/1.26.12 Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Auth-Token: gAAAAABjDTLMj6_1BqnB-U1NR4qNyXEWGKYTF3ithQCBpGKVMsSOxSrCWPoLn_0thc3iCiLqRpqhpsW9elDSGBpMEXWo8Xf3t-efj8ErnOmGL81z8XAdMByDMnprLYQQAAXhh4fqfgLlTHTinH7UjwHXQ8uKNc7cWP_0X74ygrO3884_ioHy9aQ Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Id: None Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Domain-Name: None Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Identity-Status: Confirmed Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Is-Admin-Project: True Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Id: default Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Domain-Name: Default Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Project-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Role: reader,member Aug 29 21:49:08.926738 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Roles: reader,member Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/1ba68826bbc24418aabf0c66294578ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_1ba68826bbc24418aabf0c66294578ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}] Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Id: 1ba68826bbc24418aabf0c66294578ca Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-Tenant-Name: tempest-TestVolumeBootPattern-2103636255 Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Id: default Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Domain-Name: Default Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Id: 7dceb7dc857348fda46f501288144bde Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: X-User-Name: tempest-TestVolumeBootPattern-2103636255-project Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: method: > Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: exception: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.928439 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: action_args: {'id': '98043fca-c531-4248-aee5-f52905cd742e'} Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: {{(pid=127068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:49:08.929554 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. Aug 29 21:49:08.931291 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: ERROR nova.api.openstack.wsgi Aug 29 21:49:08.933004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: DEBUG nova.api.openstack.wsgi [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Returning 404 to user: Instance 98043fca-c531-4248-aee5-f52905cd742e could not be found. {{(pid=127068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:49:08.933004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: INFO nova.api.openstack.requestlog [None req-13b66d71-442f-471c-9476-3a7dc596296e tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e" status: 404 len: 111 microversion: 2.1 time: 0.030915 Aug 29 21:49:08.933004 dv-cinder-854267-3-iscsi devstack@n-api.service[127068]: [pid: 127068|app: 0|req: 535/1092] 10.222.0.90 () {58 vars in 1236 bytes} [Mon Aug 29 21:49:08 2022] GET /compute/v2.1/servers/98043fca-c531-4248-aee5-f52905cd742e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:49:10.226650 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: DEBUG nova.api.openstack.wsgi [None req-79a83144-d497-4ee0-b46c-604979661bbc tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] Calling method '.version_select at 0x7f8bdfa76670>' {{(pid=127069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:49:10.251474 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: INFO nova.api.openstack.requestlog [None req-79a83144-d497-4ee0-b46c-604979661bbc tempest-TestVolumeBootPattern-2103636255 tempest-TestVolumeBootPattern-2103636255-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1583816455" status: 202 len: 0 microversion: 2.1 time: 0.028706 Aug 29 21:49:10.251986 dv-cinder-854267-3-iscsi devstack@n-api.service[127069]: [pid: 127069|app: 0|req: 558/1093] 10.222.0.90 () {58 vars in 1263 bytes} [Mon Aug 29 21:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1583816455 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)